Feb 27 12:23:11 devstack cinder-volume[72763]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72763) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 12:23:11 devstack cinder-volume[72763]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72763) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 12:23:11 devstack cinder-volume[72763]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72763) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 12:23:11 devstack cinder-volume[72763]: INFO dbcounter [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Registered counter for database cinder Feb 27 12:23:11 devstack cinder-volume[72763]: DEBUG oslo_db.sqlalchemy.engines [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72763) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG dbcounter [-] [72763] Writer thread running {{(pid=72763) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 12:23:12 devstack cinder-volume[72763]: INFO cinder.rpc [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 27 12:23:12 devstack cinder-volume[72763]: INFO cinder.rpc [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_db.sqlalchemy.engines [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72763) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 12:23:12 devstack cinder-volume[72763]: INFO cinder.volume.manager [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Determined volume DB was empty at startup. Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG cinder.volume.manager [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72763) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 27 12:23:12 devstack cinder-volume[72763]: INFO cinder.volume.manager [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Service not found for updating active_backend_id, assuming default for driver init. Feb 27 12:23:12 devstack cinder-volume[72763]: WARNING stevedore.named [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 12:23:12 devstack cinder-volume[72763]: WARNING castellan.key_manager [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 12:23:12 devstack cinder-volume[72763]: WARNING cinder.keymgr.conf_key_mgr [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG cinder.volume.drivers.lvm [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72763) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_concurrency.processutils [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72763) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_concurrency.processutils [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] CMD "cinder-rtstool verify" returned: 0 in 0.302s {{(pid=72763) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_db.sqlalchemy.engines [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72763) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 12:23:12 devstack cinder-volume[72763]: INFO cinder.rpc [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Feb 27 12:23:12 devstack cinder-volume[72763]: INFO cinder.rpc [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Feb 27 12:23:12 devstack cinder-volume[72763]: WARNING stevedore.named [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 12:23:12 devstack cinder-volume[72763]: WARNING castellan.key_manager [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 12:23:12 devstack cinder-volume[72763]: INFO cinder.volume.manager [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_db.sqlalchemy.engines [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72763) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 12:23:12 devstack cinder-volume[72763]: INFO oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Starting 1 workers Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Started child 73160 {{(pid=72763) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Full set of CONF: {{(pid=72763) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] ******************************************************************************** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Configuration options gathered from: {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] ================================================================================ {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] allow_availability_zone_fallback = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] allow_compression_on_image_upload = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] allowed_direct_url_schemes = [] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] api_rate_limit = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] auth_strategy = keystone {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] az_cache_duration = 3600 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_availability_zone = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_host = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_name = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_stats_polling_interval = 60 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backup_api_class = cinder.backup.api.API {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backup_name_template = backup-%s {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backup_use_same_host = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backup_use_temp_snapshot = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] chap_password = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] chap_username = {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cinder_internal_tenant_project_id = 20dc536283a644f9b11f862bbaeb6627 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cinder_internal_tenant_user_id = efda6c2532714415b8646a09af933063 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cloned_volume_same_az = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cluster = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] compression_format = gzip {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] compute_api_class = cinder.compute.nova.API {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] config_dir = [] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[73160]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] config_source = [] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] control_exchange = openstack {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] debug = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] default_availability_zone = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] default_group_type = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] default_volume_type = lvmdriver-1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] disk_geometry = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] driver_client_cert = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] driver_client_cert_key = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] driver_data_namespace = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] driver_ssl_cert_path = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] driver_ssl_cert_verify = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] driver_use_ssl = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] enable_force_upload = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] enable_new_services = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] enable_unsupported_driver = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] enforce_multipath_for_image_xfer = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] filter_function = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] glance_api_insecure = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] glance_api_servers = ['http://192.168.122.160/image'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] glance_api_ssl_compression = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] glance_ca_certificates_file = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] glance_catalog_info = image:glance:publicURL {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] glance_certfile = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] glance_keyfile = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] glance_num_retries = 3 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] glance_request_timeout = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] goodness_function = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] graceful_shutdown_timeout = 5 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] group_api_class = cinder.group.api.API {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] host = devstack {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] image_compress_on_upload = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] image_conversion_address_space_limit = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] image_conversion_cpu_limit = 60 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] image_conversion_disable = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] image_upload_use_cinder_backend = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] image_upload_use_internal_tenant = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] image_volume_cache_enabled = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] image_volume_cache_max_count = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] image_volume_cache_max_size_gb = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] init_host_max_objects_retrieval = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] instance_format = [instance: %(uuid)s] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] iscsi_target_flags = {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] iscsi_write_cache = on {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] iser_helper = tgtadm {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] iser_ip_address = 192.168.122.160 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] iser_port = 3260 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] log_color = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] log_config_append = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] log_dir = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] log_file = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] log_options = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] log_rotate_interval = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] log_rotate_interval_type = days {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] log_rotation_type = none {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] max_age = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] max_logfile_count = 30 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] max_logfile_size_mb = 200 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] max_over_subscription_ratio = 20.0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] message_reap_interval = 86400 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] message_ttl = 2592000 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] migration_create_volume_timeout_secs = 300 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] monkey_patch = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] monkey_patch_modules = [] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] my_ip = 192.168.122.160 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] no_snapshot_gb_quota = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] num_iser_scan_tries = 3 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] num_shell_tries = 3 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] num_volume_device_scan_tries = 3 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] nvmeof_conn_info_version = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] nvmet_ns_id = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] nvmet_port_id = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] osapi_max_limit = 1000 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] osapi_volume_ext_list = [] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] osapi_volume_listen_port = 8776 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] osapi_volume_use_ssl = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] osapi_volume_workers = 2 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] per_volume_size_limit = -1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] periodic_fuzzy_delay = 60 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] periodic_interval = 60 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] public_endpoint = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] publish_errors = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] quota_backup_gigabytes = 1000 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] quota_backups = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[73160]: INFO cinder.volume.manager [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Starting volume driver LVMVolumeDriver (3.0.0) Feb 27 12:23:12 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] quota_gigabytes = 1000 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] quota_groups = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] quota_snapshots = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] quota_volumes = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] rate_limit_burst = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] rate_limit_except_level = CRITICAL {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] rate_limit_interval = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] reinit_driver_count = 3 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] replication_device = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] report_discard_supported = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] report_interval = 120 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] reservation_clean_interval = 86400 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] reservation_expire = 86400 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] reserved_image_namespaces = [] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] reserved_percentage = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] rpc_response_timeout = 120 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] run_external_periodic_tasks = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] scst_target_driver = iscsi {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] scst_target_iqn_name = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] service_down_time = 720 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] shell_completion = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] snapshot_name_template = snapshot-%s {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] snapshot_same_host = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] split_loggers = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] state_path = /opt/stack/data/cinder {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] storage_availability_zone = nova {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] storage_protocol = iSCSI {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] syslog_log_facility = LOG_USER {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] target_helper = lioadm {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] target_ip_address = 192.168.122.160 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] target_port = 3260 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] target_protocol = iscsi {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] target_secondary_ip_addresses = [] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] trace_flags = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] transport_url = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] until_refresh = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] use_chap_auth = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] use_default_quota_class = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] use_journal = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] use_json = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] use_multipath_for_image_xfer = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] use_stderr = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] use_syslog = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] verify_glance_signatures = enabled {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] volume_api_class = cinder.volume.api.API {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] volume_backend_name = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] volume_clear = zero {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] volume_clear_ionice = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] volume_clear_size = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] volume_copy_bps_limit = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] volume_dd_blocksize = 1M {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] volume_name_template = volume-%s {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] volume_service_inithost_offload = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] volume_usage_audit_period = month {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] zoning_mode = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_concurrency.disable_process_locking = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.admin_password = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.admin_token = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.admin_user = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.auth_port = 35357 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.auth_protocol = https {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.auth_section = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.auth_type = password {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.auth_uri = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.auth_version = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.cache = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:12 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.certfile = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.identity_uri = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.include_service_catalog = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.insecure = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.interface = public {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.keyfile = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.memcache_password = {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.memcache_username = {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.region_name = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.service_type = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.160/identity {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.backend = dogpile.cache.null {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.backend_argument = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.backend_expiration_time = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.config_prefix = cache.oslo {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.debug_cache_backend = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.enable_retry_client = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.enable_socket_keepalive = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.enabled = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.enforce_fips_mode = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.expiration_time = 600 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.hashclient_retry_attempts = 2 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.memcache_dead_retry = 300 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.memcache_pool_maxsize = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.memcache_sasl_enabled = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.password = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.proxies = [] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.redis_db = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.redis_server = localhost:6379 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.retry_attempts = 2 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.retry_delay = 0.0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.socket_keepalive_count = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.socket_keepalive_idle = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.socket_keepalive_interval = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.socket_timeout = 1.0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.tls_allowed_ciphers = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.tls_cafile = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.tls_certfile = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.tls_enabled = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.tls_keyfile = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cache.username = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] coordination.backend_url = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] database.asyncio_connection = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] database.asyncio_slave_connection = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] database.backend = sqlalchemy {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] database.connection = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] database.connection_debug = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] database.connection_parameters = {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] database.connection_recycle_time = 3600 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] database.connection_trace = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] database.db_inc_retry_interval = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:12 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] database.db_max_retries = 20 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] database.db_max_retry_interval = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] database.db_retry_interval = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] database.max_overflow = 50 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] database.max_pool_size = 5 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] database.max_retries = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] database.mysql_wsrep_sync_wait = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] database.pool_timeout = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] database.retry_interval = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] database.slave_connection = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] database.sqlite_synchronous = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] database.synchronous_reader = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] database.use_db_reconnect = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] profiler.connection_string = messaging:// {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] profiler.enabled = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] profiler.es_doc_type = notification {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] profiler.es_scroll_size = 10000 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] profiler.es_scroll_time = 2m {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] profiler.filter_error_trace = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] profiler.hmac_keys = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] profiler.sentinel_service_name = mymaster {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] profiler.socket_timeout = 0.1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] profiler.trace_requests = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] profiler.trace_sqlalchemy = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] profiler_jaeger.process_tags = {} {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] profiler_jaeger.service_name_prefix = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] profiler_otlp.service_name_prefix = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_policy.enforce_new_defaults = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: WARNING oslo_config.cfg [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_policy.enforce_scope = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_policy.policy_default_rule = default {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_policy.policy_file = policy.yaml {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] privsep_osbrick.group = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] privsep_osbrick.helper_command = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] privsep_osbrick.user = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cinder_sys_admin.group = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cinder_sys_admin.helper_command = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] cinder_sys_admin.user = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] service_user.auth_section = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] service_user.auth_type = password {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] service_user.cafile = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] service_user.certfile = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] service_user.collect_timing = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] service_user.insecure = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] service_user.keyfile = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] service_user.send_service_user_token = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] service_user.split_loggers = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] service_user.timeout = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] glance.auth_section = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] glance.auth_type = password {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] glance.certfile = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] glance.collect_timing = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] glance.insecure = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] glance.keyfile = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] glance.region_name = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] glance.split_loggers = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] glance.timeout = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.backend_availability_zone = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.chap_password = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.chap_username = {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.disk_geometry = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.driver_client_cert = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.driver_client_cert_key = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.driver_data_namespace = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.driver_use_ssl = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.extra_capabilities = {} {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.filter_function = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.goodness_function = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.iscsi_target_flags = {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.iscsi_write_cache = on {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.iser_helper = tgtadm {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.iser_ip_address = 192.168.122.160 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.iser_port = 3260 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.lvm_share_target = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.lvm_type = auto {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.num_shell_tries = 3 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.replication_device = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.report_discard_supported = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.reserved_percentage = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.target_helper = tgtadm {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.target_ip_address = 192.168.122.160 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.target_port = 3260 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.target_protocol = iscsi {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.trace_flags = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.unique_fqdn_network = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.use_chap_auth = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.volume_backend_name = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.volume_clear = zero {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.volume_clear_ionice = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.volume_clear_size = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack sudo[73170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Feb 27 12:23:12 devstack sudo[73170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_reports.file_event_handler = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_reports.log_dir = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.backend_host = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.chap_password = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.chap_username = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.disk_geometry = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.driver_client_cert = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.extra_capabilities = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.filter_function = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.goodness_function = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.iser_helper = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.iser_ip_address = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.iser_port = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.lvm_share_target = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.lvm_type = auto {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.num_shell_tries = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.replication_device = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.report_discard_supported = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.reserved_percentage = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.scst_target_driver = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.storage_protocol = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.target_helper = lioadm {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.target_ip_address = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.target_port = 3260 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.trace_flags = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.use_chap_auth = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.volume_clear = zero {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.volume_clear_size = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] lvmdriver-1.volumes_dir = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.ssl = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_notifications.driver = [] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_notifications.retry = -1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] key_manager.fixed_key = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] barbican.barbican_api_version = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] barbican.barbican_endpoint = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] barbican.barbican_endpoint_type = public {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] barbican.barbican_region_name = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] barbican.cafile = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] barbican.certfile = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] barbican.collect_timing = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] barbican.insecure = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] barbican.keyfile = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] barbican.number_of_retries = 60 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] barbican.retry_delay = 1 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] barbican.send_service_user_token = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] barbican.split_loggers = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] barbican.timeout = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] barbican.verify_ssl = True {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] barbican.verify_ssl_path = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] barbican_service_user.auth_section = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] barbican_service_user.auth_type = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] barbican_service_user.cafile = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] barbican_service_user.certfile = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] barbican_service_user.collect_timing = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] barbican_service_user.insecure = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] barbican_service_user.keyfile = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] barbican_service_user.split_loggers = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] barbican_service_user.timeout = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] vault.approle_role_id = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] vault.approle_secret_id = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] vault.kv_mountpoint = secret {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] vault.kv_path = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] vault.kv_version = 2 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] vault.namespace = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] vault.root_token_id = **** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] vault.ssl_ca_crt_file = None {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] vault.timeout = 60.0 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] vault.use_ssl = False {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:23:12 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] ******************************************************************************** {{(pid=72763) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 27 12:23:13 devstack sudo[73170]: pam_unix(sudo:session): session closed for user root Feb 27 12:23:13 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.588s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:13 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:13 devstack sudo[73267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 12:23:13 devstack sudo[73267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:23:13 devstack sudo[73267]: pam_unix(sudo:session): session closed for user root Feb 27 12:23:13 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.504s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:13 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:23:13 devstack cinder-volume[73160]: INFO cinder.brick.local_dev.lvm [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Feb 27 12:23:13 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:13 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:13 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:13 devstack sudo[73489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 12:23:13 devstack sudo[73489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:23:14 devstack sudo[73489]: pam_unix(sudo:session): session closed for user root Feb 27 12:23:14 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.545s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:14 devstack cinder-volume[73160]: DEBUG cinder.brick.local_dev.lvm [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73160) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Feb 27 12:23:14 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:14 devstack sudo[73683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 12:23:14 devstack sudo[73683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:23:15 devstack sudo[73683]: pam_unix(sudo:session): session closed for user root Feb 27 12:23:15 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.902s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:15 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:15 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:15 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:15 devstack sudo[73847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 12:23:15 devstack sudo[73847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:23:15 devstack sudo[73847]: pam_unix(sudo:session): session closed for user root Feb 27 12:23:15 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.471s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:15 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:15 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:15 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:15 devstack sudo[73851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Feb 27 12:23:15 devstack sudo[73851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:23:16 devstack sudo[73851]: pam_unix(sudo:session): session closed for user root Feb 27 12:23:16 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.454s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:16 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:16 devstack sudo[73854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 12:23:16 devstack sudo[73854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:23:16 devstack sudo[73854]: pam_unix(sudo:session): session closed for user root Feb 27 12:23:16 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:16 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:16 devstack sudo[73862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 12:23:16 devstack sudo[73862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:23:17 devstack sudo[73862]: pam_unix(sudo:session): session closed for user root Feb 27 12:23:17 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:17 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:17 devstack sudo[73865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 12:23:17 devstack sudo[73865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:23:17 devstack sudo[73865]: pam_unix(sudo:session): session closed for user root Feb 27 12:23:17 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:17 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:17 devstack sudo[73871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 12:23:17 devstack sudo[73871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:23:18 devstack sudo[73871]: pam_unix(sudo:session): session closed for user root Feb 27 12:23:18 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.441s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:18 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:18 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:18 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:18 devstack sudo[73875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 12:23:18 devstack sudo[73875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:23:18 devstack sudo[73875]: pam_unix(sudo:session): session closed for user root Feb 27 12:23:18 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.587s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:18 devstack cinder-volume[73160]: INFO cinder.volume.drivers.lvm [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Enabling LVM thin provisioning by default because a thin pool exists. Feb 27 12:23:18 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:18 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:18 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:18 devstack sudo[73893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 12:23:18 devstack sudo[73893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:23:19 devstack sudo[73893]: pam_unix(sudo:session): session closed for user root Feb 27 12:23:19 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.474s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:19 devstack cinder-volume[73160]: DEBUG cinder.volume.drivers.lvm [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Updating volume stats {{(pid=73160) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 12:23:19 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:19 devstack sudo[73999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 12:23:19 devstack sudo[73999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:23:19 devstack sudo[73999]: pam_unix(sudo:session): session closed for user root Feb 27 12:23:19 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.516s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:19 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:19 devstack sudo[74114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 12:23:19 devstack sudo[74114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:23:20 devstack sudo[74114]: pam_unix(sudo:session): session closed for user root Feb 27 12:23:20 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.468s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:20 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:20 devstack sudo[74140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 12:23:20 devstack sudo[74140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:23:20 devstack sudo[74140]: pam_unix(sudo:session): session closed for user root Feb 27 12:23:20 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.432s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:20 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:20 devstack sudo[74146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 12:23:20 devstack sudo[74146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:23:21 devstack sudo[74146]: pam_unix(sudo:session): session closed for user root Feb 27 12:23:21 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:21 devstack cinder-volume[73160]: INFO cinder.volume.driver [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Driver hasn't implemented _init_vendor_properties() Feb 27 12:23:21 devstack cinder-volume[73160]: DEBUG cinder.volume.driver [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73160) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 27 12:23:21 devstack cinder-volume[73160]: DEBUG oslo_db.sqlalchemy.engines [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73160) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 12:23:21 devstack cinder-volume[73160]: DEBUG dbcounter [-] [73160] Writer thread running {{(pid=73160) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 12:23:21 devstack cinder-volume[73160]: DEBUG cinder.db.sqlalchemy.api [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Building query based on filter {{(pid=73160) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 27 12:23:21 devstack cinder-volume[73160]: DEBUG cinder.image.image_utils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73160) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 27 12:23:21 devstack cinder-volume[73160]: INFO cinder.keymgr.migration [None req-e1427a5d-32b7-433e-b2a0-75e49423bb38 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 27 12:23:21 devstack cinder-volume[73160]: DEBUG cinder.volume.drivers.lvm [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Updating volume stats {{(pid=73160) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 12:23:21 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:21 devstack sudo[74154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 12:23:21 devstack sudo[74154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:23:21 devstack sudo[74154]: pam_unix(sudo:session): session closed for user root Feb 27 12:23:21 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.475s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:21 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:21 devstack sudo[74157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 12:23:21 devstack sudo[74157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:23:22 devstack sudo[74157]: pam_unix(sudo:session): session closed for user root Feb 27 12:23:22 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:22 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:22 devstack sudo[74161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 12:23:22 devstack sudo[74161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:23:22 devstack cinder-volume[72763]: DEBUG dbcounter [-] [72763] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72763) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:23:22 devstack sudo[74161]: pam_unix(sudo:session): session closed for user root Feb 27 12:23:22 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.465s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:22 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:22 devstack sudo[74166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 12:23:22 devstack sudo[74166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:23:23 devstack sudo[74166]: pam_unix(sudo:session): session closed for user root Feb 27 12:23:23 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:23 devstack cinder-volume[73160]: DEBUG cinder.manager [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Notifying Schedulers of capabilities ... {{(pid=73160) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:23:23 devstack cinder-volume[73160]: INFO cinder.volume.manager [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Driver initialization completed successfully. Feb 27 12:23:23 devstack cinder-volume[73160]: INFO cinder.manager [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Initiating service 2 cleanup Feb 27 12:23:23 devstack cinder-volume[73160]: INFO cinder.manager [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Service 2 cleanup completed. Feb 27 12:23:23 devstack cinder-volume[73160]: DEBUG cinder.service [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Creating RPC server for service cinder-volume {{(pid=73160) start /opt/stack/cinder/cinder/service.py:231}} Feb 27 12:23:23 devstack cinder-volume[73160]: DEBUG cinder.service [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73160) start /opt/stack/cinder/cinder/service.py:237}} Feb 27 12:23:23 devstack cinder-volume[73160]: INFO cinder.volume.manager [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Feb 27 12:23:23 devstack cinder-volume[73160]: DEBUG cinder.volume.drivers.lvm [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Updating volume stats {{(pid=73160) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 12:23:23 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:23 devstack sudo[74174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 12:23:23 devstack sudo[74174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:23:23 devstack sudo[74174]: pam_unix(sudo:session): session closed for user root Feb 27 12:23:23 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.506s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:23 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:23 devstack sudo[74177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 12:23:23 devstack sudo[74177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:23:24 devstack sudo[74177]: pam_unix(sudo:session): session closed for user root Feb 27 12:23:24 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.454s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:24 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:24 devstack sudo[74234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 12:23:24 devstack sudo[74234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:23:24 devstack sudo[74234]: pam_unix(sudo:session): session closed for user root Feb 27 12:23:24 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.450s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:24 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:23:24 devstack sudo[74271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 12:23:24 devstack sudo[74271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:23:25 devstack sudo[74271]: pam_unix(sudo:session): session closed for user root Feb 27 12:23:25 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:23:25 devstack cinder-volume[73160]: INFO cinder.volume.manager [None req-4f1b8d87-e410-4a50-b0ef-e1702b79fe42 None None] Driver post RPC initialization completed successfully. Feb 27 12:23:33 devstack cinder-volume[73160]: DEBUG dbcounter [-] [73160] Writing DB stats cinder:SELECT=3 {{(pid=73160) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:23:35 devstack cinder-volume[73160]: DEBUG dbcounter [-] [73160] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=73160) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:25:09 devstack cinder-volume[73160]: DEBUG oslo_service.periodic_task [None req-0f27f8e1-731e-4afd-b3da-3a9ce94eedd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73160) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 12:25:09 devstack cinder-volume[73160]: DEBUG cinder.volume.drivers.lvm [None req-0f27f8e1-731e-4afd-b3da-3a9ce94eedd4 None None] Updating volume stats {{(pid=73160) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 12:25:09 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-0f27f8e1-731e-4afd-b3da-3a9ce94eedd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:25:09 devstack sudo[79568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 12:25:09 devstack sudo[79568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:25:09 devstack sudo[79568]: pam_unix(sudo:session): session closed for user root Feb 27 12:25:09 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-0f27f8e1-731e-4afd-b3da-3a9ce94eedd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.471s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:25:09 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-0f27f8e1-731e-4afd-b3da-3a9ce94eedd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:25:09 devstack sudo[79571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 12:25:09 devstack sudo[79571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:25:09 devstack sudo[79571]: pam_unix(sudo:session): session closed for user root Feb 27 12:25:09 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-0f27f8e1-731e-4afd-b3da-3a9ce94eedd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:25:09 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-0f27f8e1-731e-4afd-b3da-3a9ce94eedd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:25:09 devstack sudo[79574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 12:25:09 devstack sudo[79574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:25:10 devstack sudo[79574]: pam_unix(sudo:session): session closed for user root Feb 27 12:25:10 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-0f27f8e1-731e-4afd-b3da-3a9ce94eedd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.463s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:25:10 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-0f27f8e1-731e-4afd-b3da-3a9ce94eedd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:25:10 devstack sudo[79577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 12:25:10 devstack sudo[79577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:25:10 devstack sudo[79577]: pam_unix(sudo:session): session closed for user root Feb 27 12:25:10 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-0f27f8e1-731e-4afd-b3da-3a9ce94eedd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.473s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:25:10 devstack cinder-volume[73160]: DEBUG cinder.manager [None req-0f27f8e1-731e-4afd-b3da-3a9ce94eedd4 None None] Notifying Schedulers of capabilities ... {{(pid=73160) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:25:35 devstack cinder-volume[73160]: DEBUG dbcounter [-] [73160] Writing DB stats cinder:SELECT=1 {{(pid=73160) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:25:35 devstack cinder-volume[73160]: DEBUG dbcounter [-] [73160] Writing DB stats cinder:UPDATE=1 {{(pid=73160) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:26:09 devstack cinder-volume[73160]: DEBUG oslo_service.periodic_task [None req-0f27f8e1-731e-4afd-b3da-3a9ce94eedd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73160) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 12:26:09 devstack cinder-volume[73160]: DEBUG cinder.volume.drivers.lvm [None req-0f27f8e1-731e-4afd-b3da-3a9ce94eedd4 None None] Updating volume stats {{(pid=73160) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 12:26:09 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-0f27f8e1-731e-4afd-b3da-3a9ce94eedd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:26:09 devstack sudo[81559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 12:26:09 devstack sudo[81559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:26:09 devstack sudo[81559]: pam_unix(sudo:session): session closed for user root Feb 27 12:26:09 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-0f27f8e1-731e-4afd-b3da-3a9ce94eedd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:26:09 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-0f27f8e1-731e-4afd-b3da-3a9ce94eedd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:26:09 devstack sudo[81591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 12:26:09 devstack sudo[81591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:26:09 devstack sudo[81591]: pam_unix(sudo:session): session closed for user root Feb 27 12:26:09 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-0f27f8e1-731e-4afd-b3da-3a9ce94eedd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.449s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:26:09 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-0f27f8e1-731e-4afd-b3da-3a9ce94eedd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:26:09 devstack sudo[81599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 12:26:09 devstack sudo[81599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:26:10 devstack sudo[81599]: pam_unix(sudo:session): session closed for user root Feb 27 12:26:10 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-0f27f8e1-731e-4afd-b3da-3a9ce94eedd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.415s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:26:10 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-0f27f8e1-731e-4afd-b3da-3a9ce94eedd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:26:10 devstack sudo[81603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 12:26:10 devstack sudo[81603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:26:10 devstack sudo[81603]: pam_unix(sudo:session): session closed for user root Feb 27 12:26:10 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-0f27f8e1-731e-4afd-b3da-3a9ce94eedd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.410s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:26:10 devstack cinder-volume[73160]: DEBUG cinder.manager [None req-0f27f8e1-731e-4afd-b3da-3a9ce94eedd4 None None] Notifying Schedulers of capabilities ... {{(pid=73160) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:26:53 devstack cinder-volume[72763]: INFO oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Caught SIGTERM, stopping children Feb 27 12:26:53 devstack cinder-volume[72763]: DEBUG oslo_concurrency.lockutils [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Acquiring lock "singleton_lock" {{(pid=72763) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 12:26:53 devstack cinder-volume[72763]: DEBUG oslo_concurrency.lockutils [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Acquired lock "singleton_lock" {{(pid=72763) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 12:26:53 devstack cinder-volume[72763]: DEBUG oslo_concurrency.lockutils [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Releasing lock "singleton_lock" {{(pid=72763) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 12:26:53 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Stop services. {{(pid=72763) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Feb 27 12:26:53 devstack cinder-volume[72763]: DEBUG oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Killing children. {{(pid=72763) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Feb 27 12:26:53 devstack cinder-volume[72763]: INFO oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Waiting on 1 children to exit Feb 27 12:26:58 devstack cinder-volume[73160]: DEBUG oslo_concurrency.lockutils [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Acquiring lock "singleton_lock" {{(pid=73160) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 12:26:58 devstack cinder-volume[73160]: DEBUG oslo_concurrency.lockutils [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Acquired lock "singleton_lock" {{(pid=73160) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 12:26:58 devstack cinder-volume[73160]: DEBUG oslo_concurrency.lockutils [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Releasing lock "singleton_lock" {{(pid=73160) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 12:26:58 devstack cinder-volume[73160]: WARNING amqp [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 12:26:58 devstack cinder-volume[73160]: WARNING amqp [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 12:26:58 devstack cinder-volume[72763]: INFO oslo_service.backend._eventlet.service [None req-0c799f09-c285-422c-88da-e4b3d5432cc5 None None] Child 73160 exited with status 0 Feb 27 12:27:00 devstack cinder-volume[82593]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82593) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 12:27:00 devstack cinder-volume[82593]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82593) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 12:27:00 devstack cinder-volume[82593]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82593) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 12:27:01 devstack cinder-volume[82593]: INFO dbcounter [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] Registered counter for database cinder Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_db.sqlalchemy.engines [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82593) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG dbcounter [-] [82593] Writer thread running {{(pid=82593) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 12:27:01 devstack cinder-volume[82593]: INFO cinder.rpc [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 27 12:27:01 devstack cinder-volume[82593]: INFO cinder.rpc [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_db.sqlalchemy.engines [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82593) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 12:27:01 devstack cinder-volume[82593]: INFO cinder.volume.manager [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] Determined volume DB was empty at startup. Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG cinder.volume.manager [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82593) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 27 12:27:01 devstack cinder-volume[82593]: INFO cinder.volume.manager [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] Service not found for updating active_backend_id, assuming default for driver init. Feb 27 12:27:01 devstack cinder-volume[82593]: WARNING stevedore.named [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 12:27:01 devstack cinder-volume[82593]: WARNING castellan.key_manager [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 12:27:01 devstack cinder-volume[82593]: WARNING cinder.keymgr.conf_key_mgr [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 12:27:01 devstack cinder-volume[82593]: INFO cinder.volume.manager [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] Image-volume cache disabled for host devstack@QuobyteHD. Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_db.sqlalchemy.engines [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82593) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 12:27:01 devstack cinder-volume[82593]: INFO oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] Starting 1 workers Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] Started child 82713 {{(pid=82593) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] Full set of CONF: {{(pid=82593) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] ******************************************************************************** {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] Configuration options gathered from: {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] ================================================================================ {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] allow_availability_zone_fallback = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] allow_compression_on_image_upload = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] allowed_direct_url_schemes = [] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] api_rate_limit = True {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82713]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] auth_strategy = keystone {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_availability_zone = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_host = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_name = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_stats_polling_interval = 60 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backup_api_class = cinder.backup.api.API {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backup_name_template = backup-%s {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backup_use_same_host = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backup_use_temp_snapshot = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] chap_password = **** {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] chap_username = {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cinder_internal_tenant_project_id = 20dc536283a644f9b11f862bbaeb6627 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cinder_internal_tenant_user_id = efda6c2532714415b8646a09af933063 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cluster = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] compression_format = gzip {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] compute_api_class = cinder.compute.nova.API {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] config_dir = [] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] config_source = [] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] control_exchange = openstack {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] debug = True {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] default_availability_zone = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] default_group_type = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] default_volume_type = QuobyteHD {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] disk_geometry = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] driver_client_cert = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] driver_client_cert_key = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] driver_data_namespace = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] driver_ssl_cert_path = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] driver_ssl_cert_verify = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] driver_use_ssl = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] enable_new_services = True {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] enable_unsupported_driver = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] enabled_backends = ['QuobyteHD'] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] enforce_multipath_for_image_xfer = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] filter_function = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] glance_api_insecure = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] glance_api_servers = ['http://192.168.122.160/image'] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] glance_api_ssl_compression = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] glance_ca_certificates_file = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] glance_catalog_info = image:glance:publicURL {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] glance_certfile = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] glance_keyfile = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] glance_num_retries = 3 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] glance_request_timeout = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] goodness_function = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] graceful_shutdown_timeout = 5 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] group_api_class = cinder.group.api.API {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] host = devstack {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] image_compress_on_upload = True {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] image_conversion_address_space_limit = 1 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] image_conversion_cpu_limit = 60 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] image_conversion_disable = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] image_upload_use_cinder_backend = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] image_upload_use_internal_tenant = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] image_volume_cache_enabled = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] image_volume_cache_max_count = 0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] image_volume_cache_max_size_gb = 0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] init_host_max_objects_retrieval = 0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] instance_format = [instance: %(uuid)s] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] iscsi_target_flags = {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] iscsi_write_cache = on {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] iser_helper = tgtadm {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] iser_ip_address = 192.168.122.160 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] iser_port = 3260 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] log_color = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] log_config_append = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] log_dir = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] log_file = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] log_options = True {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] log_rotate_interval = 1 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] log_rotate_interval_type = days {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] log_rotation_type = none {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] max_age = 0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] max_logfile_count = 30 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] max_logfile_size_mb = 200 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] max_over_subscription_ratio = 20.0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] message_reap_interval = 86400 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] message_ttl = 2592000 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] migration_create_volume_timeout_secs = 300 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] monkey_patch = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] monkey_patch_modules = [] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] my_ip = 192.168.122.160 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] no_snapshot_gb_quota = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] num_iser_scan_tries = 3 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] num_shell_tries = 3 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] num_volume_device_scan_tries = 3 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] nvmeof_conn_info_version = 1 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] nvmet_ns_id = 10 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] nvmet_port_id = 1 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] osapi_max_limit = 1000 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] osapi_volume_ext_list = [] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] osapi_volume_listen_port = 8776 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] osapi_volume_use_ssl = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] osapi_volume_workers = 2 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82713]: INFO cinder.volume.manager [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Starting volume driver QuobyteDriver (1.1.14) Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] per_volume_size_limit = -1 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] periodic_fuzzy_delay = 60 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] periodic_interval = 60 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] public_endpoint = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] publish_errors = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] quota_backup_gigabytes = 1000 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] quota_backups = 10 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] quota_gigabytes = 1000 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] quota_groups = 10 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] quota_snapshots = 10 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82713]: DEBUG cinder.volume.drivers.remotefs [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82713) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] quota_volumes = 10 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] rate_limit_burst = 0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] rate_limit_except_level = CRITICAL {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] rate_limit_interval = 0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] reinit_driver_count = 3 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] replication_device = **** {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] report_discard_supported = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] report_interval = 120 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] reservation_clean_interval = 86400 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] reservation_expire = 86400 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] reserved_image_namespaces = [] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] reserved_percentage = 0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] rpc_response_timeout = 120 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] run_external_periodic_tasks = True {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] scst_target_driver = iscsi {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] scst_target_iqn_name = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] service_down_time = 720 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] shell_completion = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] snapshot_name_template = snapshot-%s {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] split_loggers = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] state_path = /opt/stack/data/cinder {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] storage_availability_zone = nova {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] storage_protocol = iSCSI {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] syslog_log_facility = LOG_USER {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] target_helper = lioadm {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] target_ip_address = 192.168.122.160 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] target_port = 3260 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] target_protocol = iscsi {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] target_secondary_ip_addresses = [] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] trace_flags = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] transport_url = **** {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] until_refresh = 0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] use_chap_auth = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] use_default_quota_class = True {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] use_journal = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] use_json = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] use_multipath_for_image_xfer = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] use_stderr = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] use_syslog = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] verify_glance_signatures = enabled {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] volume_api_class = cinder.volume.api.API {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] volume_backend_name = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] volume_clear = zero {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] volume_clear_ionice = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] volume_clear_size = 0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] volume_copy_bps_limit = 0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] volume_dd_blocksize = 1M {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] volume_name_template = volume-%s {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] volume_service_inithost_offload = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] volume_usage_audit_period = month {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] zoning_mode = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_concurrency.disable_process_locking = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.admin_password = **** {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.admin_token = **** {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.admin_user = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.auth_port = 35357 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.auth_protocol = https {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.auth_section = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.auth_type = password {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.auth_uri = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.auth_version = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.cache = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.certfile = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.identity_uri = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.include_service_catalog = True {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.insecure = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.interface = public {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.keyfile = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.memcache_password = {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.memcache_username = {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.region_name = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.service_type = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.160/identity {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.backend = dogpile.cache.null {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.backend_argument = **** {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.backend_expiration_time = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.config_prefix = cache.oslo {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.debug_cache_backend = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.enable_retry_client = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.enable_socket_keepalive = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.enabled = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.enforce_fips_mode = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.expiration_time = 600 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.hashclient_retry_attempts = 2 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.memcache_dead_retry = 300 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.memcache_pool_maxsize = 10 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.memcache_sasl_enabled = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.password = **** {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.proxies = [] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.redis_db = 0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.redis_server = localhost:6379 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.retry_attempts = 2 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.retry_delay = 0.0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.socket_keepalive_count = 1 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.socket_keepalive_idle = 1 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.socket_keepalive_interval = 1 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.socket_timeout = 1.0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.tls_allowed_ciphers = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.tls_cafile = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.tls_certfile = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.tls_enabled = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.tls_keyfile = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cache.username = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] coordination.backend_url = **** {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] database.asyncio_connection = **** {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] database.asyncio_slave_connection = **** {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] database.backend = sqlalchemy {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] database.connection = **** {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] database.connection_debug = 0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] database.connection_parameters = {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] database.connection_recycle_time = 3600 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] database.connection_trace = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] database.db_inc_retry_interval = True {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] database.db_max_retries = 20 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] database.db_max_retry_interval = 10 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] database.db_retry_interval = 1 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] database.max_overflow = 50 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] database.max_pool_size = 5 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] database.max_retries = 10 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] database.mysql_wsrep_sync_wait = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] database.pool_timeout = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] database.retry_interval = 10 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] database.slave_connection = **** {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] database.sqlite_synchronous = True {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] database.synchronous_reader = True {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] database.use_db_reconnect = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] profiler.connection_string = messaging:// {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] profiler.enabled = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] profiler.es_doc_type = notification {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] profiler.es_scroll_size = 10000 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] profiler.es_scroll_time = 2m {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] profiler.filter_error_trace = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] profiler.hmac_keys = **** {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] profiler.sentinel_service_name = mymaster {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] profiler.socket_timeout = 0.1 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] profiler.trace_requests = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] profiler.trace_sqlalchemy = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] profiler_jaeger.process_tags = {} {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] profiler_jaeger.service_name_prefix = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] profiler_otlp.service_name_prefix = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_policy.enforce_new_defaults = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: WARNING oslo_config.cfg [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_policy.enforce_scope = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_policy.policy_default_rule = default {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_policy.policy_file = policy.yaml {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] privsep_osbrick.group = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] privsep_osbrick.helper_command = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] privsep_osbrick.user = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cinder_sys_admin.group = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cinder_sys_admin.helper_command = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] cinder_sys_admin.user = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] service_user.auth_section = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] service_user.auth_type = password {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] service_user.cafile = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] service_user.certfile = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] service_user.collect_timing = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] service_user.insecure = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] service_user.keyfile = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] service_user.send_service_user_token = True {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] service_user.split_loggers = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] service_user.timeout = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] glance.auth_section = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] glance.auth_type = password {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82713]: DEBUG cinder.volume.drivers.quobyte [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82713) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] glance.certfile = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82713]: WARNING cinder.volume.drivers.quobyte [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] glance.collect_timing = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82713]: WARNING cinder.volume.drivers.quobyte [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] glance.insecure = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] glance.keyfile = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] glance.region_name = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] glance.split_loggers = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] glance.timeout = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.backend_availability_zone = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82713]: DEBUG oslo_concurrency.processutils [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Running cmd (subprocess): mount.quobyte {{(pid=82713) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.chap_password = **** {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.chap_username = {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.disk_geometry = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.driver_client_cert = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.driver_client_cert_key = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.driver_data_namespace = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.driver_use_ssl = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.extra_capabilities = {} {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.filter_function = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.goodness_function = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.iscsi_target_flags = {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.iscsi_write_cache = on {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.iser_helper = tgtadm {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.iser_ip_address = 192.168.122.160 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.iser_port = 3260 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.nas_host = {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.nas_login = admin {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.nas_mount_options = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.nas_password = **** {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.nas_private_key = {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.nas_share_path = {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.num_shell_tries = 3 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.quobyte_volume_url = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.replication_device = **** {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.report_discard_supported = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.reserved_percentage = 0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.target_helper = tgtadm {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.target_ip_address = 192.168.122.160 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.target_port = 3260 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.target_protocol = iscsi {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.trace_flags = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.unique_fqdn_network = True {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.use_chap_auth = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.volume_backend_name = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.volume_clear = zero {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.volume_clear_ionice = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.volume_clear_size = 0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_reports.file_event_handler = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_reports.log_dir = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.backend_availability_zone = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.backend_host = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.chap_password = **** {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.chap_username = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.chiscsi_conf = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.disk_geometry = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.driver_client_cert = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.driver_data_namespace = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.driver_use_ssl = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.extra_capabilities = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.filter_function = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.goodness_function = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.iser_helper = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.iser_ip_address = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.iser_port = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.iser_target_prefix = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.nas_host = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.nas_login = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.nas_mount_options = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.nas_password = **** {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.nas_private_key = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.nas_share_path = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.nas_ssh_port = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.num_shell_tries = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.nvmet_port_id = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.replication_device = **** {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.report_discard_supported = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.reserved_percentage = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.scst_target_driver = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.storage_protocol = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.target_helper = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.target_ip_address = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.target_port = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.target_prefix = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.target_protocol = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.trace_flags = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.use_chap_auth = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.volume_clear = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.volume_clear_size = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] QuobyteHD.volumes_dir = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack quobyte-client[82714]: Reading configuration file: /etc/quobyte/client.cfg Feb 27 12:27:01 devstack quobyte-client[82714]: Invalid parameters found, error: missing mount point. Feb 27 12:27:01 devstack quobyte-client[82714]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Feb 27 12:27:01 devstack quobyte-client[82714]: Failed to parse all commandline parameters, please use -h/--help to see available options. Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.ssl = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_notifications.driver = [] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_notifications.retry = -1 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] key_manager.fixed_key = **** {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] barbican.barbican_api_version = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] barbican.barbican_endpoint = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] barbican.barbican_endpoint_type = public {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] barbican.barbican_region_name = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] barbican.cafile = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82713]: DEBUG oslo_concurrency.processutils [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] CMD "mount.quobyte" returned: 1 in 0.087s {{(pid=82713) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] barbican.certfile = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] barbican.collect_timing = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82713]: DEBUG oslo_concurrency.lockutils [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82713) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] barbican.insecure = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82713]: DEBUG oslo_concurrency.lockutils [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82713) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:27:01 devstack cinder-volume[82713]: DEBUG cinder.volume.drivers.quobyte [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=82713) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] barbican.keyfile = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] barbican.number_of_retries = 60 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82713]: INFO cinder.volume.drivers.quobyte [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 ... Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] barbican.retry_delay = 1 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82713]: DEBUG oslo_concurrency.processutils [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e -c /etc/quobyte/client-cinder.cfg {{(pid=82713) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] barbican.send_service_user_token = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] barbican.split_loggers = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] barbican.timeout = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] barbican.verify_ssl = True {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] barbican.verify_ssl_path = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] barbican_service_user.auth_section = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] barbican_service_user.auth_type = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] barbican_service_user.cafile = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] barbican_service_user.certfile = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] barbican_service_user.collect_timing = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] barbican_service_user.insecure = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] barbican_service_user.keyfile = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] barbican_service_user.split_loggers = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] barbican_service_user.timeout = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] vault.approle_role_id = **** {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] vault.approle_secret_id = **** {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] vault.kv_mountpoint = secret {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] vault.kv_path = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] vault.kv_version = 2 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] vault.namespace = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] vault.root_token_id = **** {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] vault.ssl_ca_crt_file = None {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] vault.timeout = 60.0 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] vault.use_ssl = False {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:01 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] ******************************************************************************** {{(pid=82593) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 27 12:27:01 devstack sudo[82715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e -c /etc/quobyte/client-cinder.cfg Feb 27 12:27:01 devstack sudo[82715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:27:02 devstack sudo[82715]: pam_unix(sudo:session): session closed for user root Feb 27 12:27:02 devstack cinder-volume[82713]: DEBUG oslo_concurrency.processutils [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.485s {{(pid=82713) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:27:02 devstack cinder-volume[82713]: INFO cinder.volume.drivers.quobyte [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 succeeded Feb 27 12:27:02 devstack cinder-volume[82713]: DEBUG cinder.volume.drivers.quobyte [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=82713) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:27:02 devstack cinder-volume[82713]: DEBUG oslo_concurrency.lockutils [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.511s {{(pid=82713) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:27:02 devstack cinder-volume[82713]: DEBUG oslo_concurrency.processutils [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=82713) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:27:02 devstack sudo[82786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:27:02 devstack sudo[82786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:27:02 devstack sudo[82786]: pam_unix(sudo:session): session closed for user root Feb 27 12:27:02 devstack cinder-volume[82713]: DEBUG oslo_concurrency.processutils [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.447s {{(pid=82713) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:27:02 devstack cinder-volume[82713]: INFO cinder.volume.driver [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Driver hasn't implemented _init_vendor_properties() Feb 27 12:27:02 devstack cinder-volume[82713]: DEBUG cinder.volume.driver [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580642700195, 'free_capacity_gb': 1775.7580642700195, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82713) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 27 12:27:02 devstack cinder-volume[82713]: DEBUG oslo_db.sqlalchemy.engines [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82713) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 12:27:02 devstack cinder-volume[82713]: DEBUG dbcounter [-] [82713] Writer thread running {{(pid=82713) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 12:27:02 devstack cinder-volume[82713]: DEBUG cinder.db.sqlalchemy.api [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Building query based on filter {{(pid=82713) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 27 12:27:02 devstack cinder-volume[82713]: DEBUG cinder.image.image_utils [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82713) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 27 12:27:02 devstack cinder-volume[82713]: INFO cinder.keymgr.migration [None req-c32eeb7d-2733-4f9a-9cd0-6180acec4511 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 27 12:27:02 devstack cinder-volume[82713]: DEBUG oslo_concurrency.lockutils [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82713) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:27:02 devstack cinder-volume[82713]: DEBUG oslo_concurrency.lockutils [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82713) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:27:02 devstack cinder-volume[82713]: DEBUG cinder.volume.drivers.quobyte [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=82713) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:27:02 devstack cinder-volume[82713]: DEBUG cinder.volume.drivers.quobyte [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=82713) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:27:02 devstack cinder-volume[82713]: DEBUG oslo_concurrency.lockutils [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82713) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:27:02 devstack cinder-volume[82713]: DEBUG oslo_concurrency.processutils [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=82713) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:27:02 devstack sudo[82789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:27:02 devstack sudo[82789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:27:02 devstack sudo[82789]: pam_unix(sudo:session): session closed for user root Feb 27 12:27:02 devstack cinder-volume[82713]: DEBUG oslo_concurrency.processutils [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.366s {{(pid=82713) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:27:02 devstack cinder-volume[82713]: DEBUG cinder.manager [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Notifying Schedulers of capabilities ... {{(pid=82713) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:27:03 devstack cinder-volume[82713]: INFO cinder.volume.manager [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Driver initialization completed successfully. Feb 27 12:27:03 devstack cinder-volume[82713]: INFO cinder.manager [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Initiating service 3 cleanup Feb 27 12:27:03 devstack cinder-volume[82713]: INFO cinder.manager [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Service 3 cleanup completed. Feb 27 12:27:03 devstack cinder-volume[82713]: DEBUG cinder.service [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Creating RPC server for service cinder-volume {{(pid=82713) start /opt/stack/cinder/cinder/service.py:231}} Feb 27 12:27:03 devstack cinder-volume[82713]: DEBUG cinder.service [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82713) start /opt/stack/cinder/cinder/service.py:237}} Feb 27 12:27:03 devstack cinder-volume[82713]: INFO cinder.volume.manager [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Feb 27 12:27:03 devstack cinder-volume[82713]: DEBUG oslo_concurrency.lockutils [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82713) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:27:03 devstack cinder-volume[82713]: DEBUG oslo_concurrency.lockutils [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82713) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:27:03 devstack cinder-volume[82713]: DEBUG cinder.volume.drivers.quobyte [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=82713) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:27:03 devstack cinder-volume[82713]: DEBUG cinder.volume.drivers.quobyte [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=82713) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:27:03 devstack cinder-volume[82713]: DEBUG oslo_concurrency.lockutils [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82713) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:27:03 devstack cinder-volume[82713]: DEBUG oslo_concurrency.processutils [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=82713) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:27:03 devstack sudo[82795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:27:03 devstack sudo[82795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:27:03 devstack sudo[82795]: pam_unix(sudo:session): session closed for user root Feb 27 12:27:03 devstack cinder-volume[82713]: DEBUG oslo_concurrency.processutils [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.409s {{(pid=82713) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:27:03 devstack cinder-volume[82713]: INFO cinder.volume.manager [None req-a499ccbc-9502-4827-a40e-7522fa8da0de None None] Driver post RPC initialization completed successfully. Feb 27 12:27:06 devstack cinder-volume[82713]: DEBUG oslo_concurrency.lockutils [None req-2ac42a55-ffd3-4d99-ad78-31cd8bdda2a6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82713) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:27:06 devstack cinder-volume[82713]: DEBUG oslo_concurrency.lockutils [None req-2ac42a55-ffd3-4d99-ad78-31cd8bdda2a6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82713) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:27:06 devstack cinder-volume[82713]: DEBUG cinder.volume.drivers.quobyte [None req-2ac42a55-ffd3-4d99-ad78-31cd8bdda2a6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=82713) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:27:06 devstack cinder-volume[82713]: DEBUG cinder.volume.drivers.quobyte [None req-2ac42a55-ffd3-4d99-ad78-31cd8bdda2a6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=82713) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:27:06 devstack cinder-volume[82713]: DEBUG oslo_concurrency.lockutils [None req-2ac42a55-ffd3-4d99-ad78-31cd8bdda2a6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82713) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:27:06 devstack cinder-volume[82713]: DEBUG oslo_concurrency.processutils [None req-2ac42a55-ffd3-4d99-ad78-31cd8bdda2a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=82713) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:27:06 devstack sudo[82859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:27:06 devstack sudo[82859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:27:06 devstack sudo[82859]: pam_unix(sudo:session): session closed for user root Feb 27 12:27:06 devstack cinder-volume[82713]: DEBUG oslo_concurrency.processutils [None req-2ac42a55-ffd3-4d99-ad78-31cd8bdda2a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.365s {{(pid=82713) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:27:06 devstack cinder-volume[82713]: DEBUG cinder.manager [None req-2ac42a55-ffd3-4d99-ad78-31cd8bdda2a6 None None] Notifying Schedulers of capabilities ... {{(pid=82713) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:27:10 devstack cinder-volume[82593]: INFO oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] Caught SIGTERM, stopping children Feb 27 12:27:10 devstack cinder-volume[82593]: DEBUG oslo_concurrency.lockutils [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] Acquiring lock "singleton_lock" {{(pid=82593) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 12:27:10 devstack cinder-volume[82593]: DEBUG oslo_concurrency.lockutils [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] Acquired lock "singleton_lock" {{(pid=82593) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 12:27:10 devstack cinder-volume[82593]: DEBUG oslo_concurrency.lockutils [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] Releasing lock "singleton_lock" {{(pid=82593) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 12:27:10 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] Stop services. {{(pid=82593) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Feb 27 12:27:10 devstack cinder-volume[82593]: DEBUG oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] Killing children. {{(pid=82593) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Feb 27 12:27:10 devstack cinder-volume[82593]: INFO oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] Waiting on 1 children to exit Feb 27 12:27:11 devstack cinder-volume[82713]: DEBUG oslo_concurrency.lockutils [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] Acquiring lock "singleton_lock" {{(pid=82713) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 12:27:11 devstack cinder-volume[82713]: DEBUG oslo_concurrency.lockutils [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] Acquired lock "singleton_lock" {{(pid=82713) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 12:27:11 devstack cinder-volume[82713]: DEBUG oslo_concurrency.lockutils [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] Releasing lock "singleton_lock" {{(pid=82713) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 12:27:11 devstack cinder-volume[82713]: WARNING amqp [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 12:27:11 devstack cinder-volume[82713]: WARNING amqp [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 12:27:11 devstack cinder-volume[82593]: INFO oslo_service.backend._eventlet.service [None req-a5b34c1d-4bc8-4ec6-8fdf-4c33e82e5623 None None] Child 82713 exited with status 0 Feb 27 12:27:13 devstack cinder-volume[82931]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 12:27:13 devstack cinder-volume[82931]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 12:27:13 devstack cinder-volume[82931]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 12:27:13 devstack cinder-volume[82931]: INFO dbcounter [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] Registered counter for database cinder Feb 27 12:27:13 devstack cinder-volume[82931]: DEBUG oslo_db.sqlalchemy.engines [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82931) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG dbcounter [-] [82931] Writer thread running {{(pid=82931) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 12:27:14 devstack cinder-volume[82931]: INFO cinder.rpc [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 27 12:27:14 devstack cinder-volume[82931]: INFO cinder.rpc [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_db.sqlalchemy.engines [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82931) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 12:27:14 devstack cinder-volume[82931]: INFO cinder.volume.manager [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] Determined volume DB was empty at startup. Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG cinder.volume.manager [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82931) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 27 12:27:14 devstack cinder-volume[82931]: WARNING stevedore.named [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 12:27:14 devstack cinder-volume[82931]: WARNING castellan.key_manager [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 12:27:14 devstack cinder-volume[82931]: WARNING cinder.keymgr.conf_key_mgr [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 12:27:14 devstack cinder-volume[82931]: INFO cinder.volume.manager [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] Image-volume cache disabled for host devstack@QuobyteHD. Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_db.sqlalchemy.engines [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82931) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 12:27:14 devstack cinder-volume[82931]: INFO oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] Starting 1 workers Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] Started child 83077 {{(pid=82931) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] Full set of CONF: {{(pid=82931) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] ******************************************************************************** {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] Configuration options gathered from: {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] ================================================================================ {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] allow_availability_zone_fallback = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] allow_compression_on_image_upload = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] allowed_direct_url_schemes = [] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] api_rate_limit = True {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] auth_strategy = keystone {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_availability_zone = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_host = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_name = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_stats_polling_interval = 60 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backup_api_class = cinder.backup.api.API {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backup_name_template = backup-%s {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backup_use_same_host = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backup_use_temp_snapshot = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] chap_password = **** {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] chap_username = {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cinder_internal_tenant_project_id = 20dc536283a644f9b11f862bbaeb6627 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cinder_internal_tenant_user_id = efda6c2532714415b8646a09af933063 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cluster = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] compression_format = gzip {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] compute_api_class = cinder.compute.nova.API {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] config_dir = [] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] config_source = [] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] control_exchange = openstack {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] debug = True {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] default_availability_zone = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] default_group_type = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] default_volume_type = QuobyteHD {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] disk_geometry = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] driver_client_cert = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] driver_client_cert_key = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] driver_data_namespace = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] driver_ssl_cert_path = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] driver_ssl_cert_verify = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] driver_use_ssl = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] enable_new_services = True {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] enable_unsupported_driver = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] enabled_backends = ['QuobyteHD'] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] enforce_multipath_for_image_xfer = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] filter_function = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] glance_api_insecure = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] glance_api_servers = ['http://192.168.122.160/image'] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] glance_api_ssl_compression = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] glance_ca_certificates_file = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] glance_catalog_info = image:glance:publicURL {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] glance_certfile = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] glance_keyfile = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[83077]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] glance_num_retries = 3 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] glance_request_timeout = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] goodness_function = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] graceful_shutdown_timeout = 5 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] group_api_class = cinder.group.api.API {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] host = devstack {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] image_compress_on_upload = True {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] image_conversion_address_space_limit = 1 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] image_conversion_cpu_limit = 60 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] image_conversion_disable = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] image_upload_use_cinder_backend = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] image_upload_use_internal_tenant = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] image_volume_cache_enabled = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] image_volume_cache_max_count = 0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] image_volume_cache_max_size_gb = 0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] init_host_max_objects_retrieval = 0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] instance_format = [instance: %(uuid)s] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] iscsi_target_flags = {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] iscsi_write_cache = on {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] iser_helper = tgtadm {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] iser_ip_address = 192.168.122.160 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] iser_port = 3260 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] log_color = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] log_config_append = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] log_dir = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] log_file = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] log_options = True {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] log_rotate_interval = 1 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] log_rotate_interval_type = days {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] log_rotation_type = none {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] max_age = 0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] max_logfile_count = 30 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] max_logfile_size_mb = 200 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] max_over_subscription_ratio = 20.0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] message_reap_interval = 86400 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] message_ttl = 2592000 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] migration_create_volume_timeout_secs = 300 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] monkey_patch = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] monkey_patch_modules = [] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] my_ip = 192.168.122.160 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] no_snapshot_gb_quota = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] num_iser_scan_tries = 3 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] num_shell_tries = 3 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] num_volume_device_scan_tries = 3 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] nvmeof_conn_info_version = 1 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] nvmet_ns_id = 10 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] nvmet_port_id = 1 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] osapi_max_limit = 1000 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] osapi_volume_ext_list = [] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] osapi_volume_listen_port = 8776 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] osapi_volume_use_ssl = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] osapi_volume_workers = 2 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] per_volume_size_limit = -1 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] periodic_fuzzy_delay = 60 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] periodic_interval = 60 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] public_endpoint = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] publish_errors = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] quota_backup_gigabytes = 1000 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] quota_backups = 10 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] quota_gigabytes = 1000 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] quota_groups = 10 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] quota_snapshots = 10 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] quota_volumes = 10 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] rate_limit_burst = 0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] rate_limit_except_level = CRITICAL {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] rate_limit_interval = 0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] reinit_driver_count = 3 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] replication_device = **** {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] report_discard_supported = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] report_interval = 120 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] reservation_clean_interval = 86400 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] reservation_expire = 86400 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] reserved_image_namespaces = [] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] reserved_percentage = 0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] rpc_response_timeout = 120 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] run_external_periodic_tasks = True {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] scst_target_driver = iscsi {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] scst_target_iqn_name = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] service_down_time = 720 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] shell_completion = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] snapshot_name_template = snapshot-%s {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] split_loggers = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] state_path = /opt/stack/data/cinder {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] storage_availability_zone = nova {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] storage_protocol = iSCSI {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] syslog_log_facility = LOG_USER {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] target_helper = lioadm {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] target_ip_address = 192.168.122.160 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] target_port = 3260 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] target_protocol = iscsi {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] target_secondary_ip_addresses = [] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] trace_flags = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Starting volume driver QuobyteDriver (1.1.14) Feb 27 12:27:14 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-17493aef-07e3-4663-bad0-933fab33681d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83077) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] transport_url = **** {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] until_refresh = 0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] use_chap_auth = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] use_default_quota_class = True {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] use_journal = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] use_json = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] use_multipath_for_image_xfer = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] use_stderr = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] use_syslog = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] verify_glance_signatures = enabled {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] volume_api_class = cinder.volume.api.API {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] volume_backend_name = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] volume_clear = zero {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] volume_clear_ionice = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] volume_clear_size = 0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] volume_copy_bps_limit = 0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] volume_dd_blocksize = 1M {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] volume_name_template = volume-%s {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] volume_service_inithost_offload = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] volume_usage_audit_period = month {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] zoning_mode = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_concurrency.disable_process_locking = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.admin_password = **** {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.admin_token = **** {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.admin_user = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.auth_port = 35357 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.auth_protocol = https {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.auth_section = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.auth_type = password {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.auth_uri = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.auth_version = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.cache = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.certfile = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.identity_uri = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.include_service_catalog = True {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.insecure = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.interface = public {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.keyfile = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.memcache_password = {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.memcache_username = {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.region_name = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.service_type = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.160/identity {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.backend = dogpile.cache.null {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.backend_argument = **** {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.backend_expiration_time = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.config_prefix = cache.oslo {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.debug_cache_backend = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.enable_retry_client = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.enable_socket_keepalive = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.enabled = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.enforce_fips_mode = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.expiration_time = 600 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.hashclient_retry_attempts = 2 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.memcache_dead_retry = 300 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.memcache_pool_maxsize = 10 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.memcache_sasl_enabled = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.password = **** {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.proxies = [] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.redis_db = 0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.redis_server = localhost:6379 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.retry_attempts = 2 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.retry_delay = 0.0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.socket_keepalive_count = 1 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.socket_keepalive_idle = 1 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.socket_keepalive_interval = 1 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.socket_timeout = 1.0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.tls_allowed_ciphers = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.tls_cafile = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.tls_certfile = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.tls_enabled = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.tls_keyfile = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cache.username = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] coordination.backend_url = **** {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] database.asyncio_connection = **** {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] database.asyncio_slave_connection = **** {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] database.backend = sqlalchemy {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] database.connection = **** {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] database.connection_debug = 0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] database.connection_parameters = {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] database.connection_recycle_time = 3600 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] database.connection_trace = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] database.db_inc_retry_interval = True {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] database.db_max_retries = 20 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] database.db_max_retry_interval = 10 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] database.db_retry_interval = 1 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] database.max_overflow = 50 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] database.max_pool_size = 5 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] database.max_retries = 10 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] database.mysql_wsrep_sync_wait = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] database.pool_timeout = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] database.retry_interval = 10 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] database.slave_connection = **** {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] database.sqlite_synchronous = True {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] database.synchronous_reader = True {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] database.use_db_reconnect = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] profiler.connection_string = messaging:// {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] profiler.enabled = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] profiler.es_doc_type = notification {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] profiler.es_scroll_size = 10000 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] profiler.es_scroll_time = 2m {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] profiler.filter_error_trace = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] profiler.hmac_keys = **** {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] profiler.sentinel_service_name = mymaster {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] profiler.socket_timeout = 0.1 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] profiler.trace_requests = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] profiler.trace_sqlalchemy = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-17493aef-07e3-4663-bad0-933fab33681d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83077) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Feb 27 12:27:14 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.quobyte [None req-17493aef-07e3-4663-bad0-933fab33681d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Feb 27 12:27:14 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.quobyte [None req-17493aef-07e3-4663-bad0-933fab33681d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Feb 27 12:27:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Running cmd (subprocess): mount.quobyte {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] profiler_jaeger.process_tags = {} {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] profiler_jaeger.service_name_prefix = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] profiler_otlp.service_name_prefix = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_policy.enforce_new_defaults = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: WARNING oslo_config.cfg [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_policy.enforce_scope = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_policy.policy_default_rule = default {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_policy.policy_file = policy.yaml {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] privsep_osbrick.group = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] privsep_osbrick.helper_command = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] privsep_osbrick.user = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cinder_sys_admin.group = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cinder_sys_admin.helper_command = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] cinder_sys_admin.user = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] service_user.auth_section = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] service_user.auth_type = password {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] service_user.cafile = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] service_user.certfile = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] service_user.collect_timing = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] service_user.insecure = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] service_user.keyfile = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] service_user.send_service_user_token = True {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] service_user.split_loggers = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] service_user.timeout = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] glance.auth_section = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] glance.auth_type = password {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] glance.certfile = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] glance.collect_timing = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] glance.insecure = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] glance.keyfile = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] glance.region_name = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] glance.split_loggers = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] glance.timeout = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.backend_availability_zone = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.chap_password = **** {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.chap_username = {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.disk_geometry = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.driver_client_cert = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.driver_client_cert_key = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.driver_data_namespace = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.driver_use_ssl = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.extra_capabilities = {} {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.filter_function = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.goodness_function = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.iscsi_target_flags = {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.iscsi_write_cache = on {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.iser_helper = tgtadm {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.iser_ip_address = 192.168.122.160 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.iser_port = 3260 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.nas_host = {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.nas_login = admin {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.nas_mount_options = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.nas_password = **** {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.nas_private_key = {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.nas_share_path = {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.num_shell_tries = 3 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.quobyte_volume_url = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.replication_device = **** {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.report_discard_supported = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.reserved_percentage = 0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.target_helper = tgtadm {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.target_ip_address = 192.168.122.160 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.target_port = 3260 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.target_protocol = iscsi {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.trace_flags = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.unique_fqdn_network = True {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.use_chap_auth = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.volume_backend_name = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.volume_clear = zero {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.volume_clear_ionice = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.volume_clear_size = 0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_reports.file_event_handler = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_reports.log_dir = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.backend_availability_zone = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.backend_host = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.chap_password = **** {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.chap_username = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.chiscsi_conf = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.disk_geometry = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.driver_client_cert = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.driver_data_namespace = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.driver_use_ssl = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.extra_capabilities = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.filter_function = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.goodness_function = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.iser_helper = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.iser_ip_address = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.iser_port = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.iser_target_prefix = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.nas_host = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.nas_login = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.nas_mount_options = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.nas_password = **** {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.nas_private_key = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.nas_share_path = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.nas_ssh_port = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.num_shell_tries = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.nvmet_port_id = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.replication_device = **** {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.report_discard_supported = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.reserved_percentage = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.scst_target_driver = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.storage_protocol = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.target_helper = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.target_ip_address = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.target_port = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.target_prefix = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.target_protocol = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.trace_flags = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.use_chap_auth = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.volume_clear = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.volume_clear_size = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] QuobyteHD.volumes_dir = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.ssl = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_notifications.driver = [] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_notifications.retry = -1 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] key_manager.fixed_key = **** {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] barbican.barbican_api_version = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] barbican.barbican_endpoint = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] barbican.barbican_endpoint_type = public {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] barbican.barbican_region_name = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] barbican.cafile = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] barbican.certfile = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] barbican.collect_timing = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] barbican.insecure = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] barbican.keyfile = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] barbican.number_of_retries = 60 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] barbican.retry_delay = 1 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] barbican.send_service_user_token = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] barbican.split_loggers = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] barbican.timeout = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] barbican.verify_ssl = True {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] barbican.verify_ssl_path = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] barbican_service_user.auth_section = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] barbican_service_user.auth_type = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] barbican_service_user.cafile = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] barbican_service_user.certfile = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] barbican_service_user.collect_timing = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] barbican_service_user.insecure = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] barbican_service_user.keyfile = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] barbican_service_user.split_loggers = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] barbican_service_user.timeout = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] vault.approle_role_id = **** {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] vault.approle_secret_id = **** {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] vault.kv_mountpoint = secret {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] vault.kv_path = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] vault.kv_version = 2 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] vault.namespace = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] vault.root_token_id = **** {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] vault.ssl_ca_crt_file = None {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] vault.timeout = 60.0 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] vault.use_ssl = False {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:27:14 devstack cinder-volume[82931]: DEBUG oslo_service.backend._eventlet.service [None req-d09cd8a8-86e5-4a0c-9bf6-c2b8dd56be58 None None] ******************************************************************************** {{(pid=82931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 27 12:27:14 devstack quobyte-client[83106]: Reading configuration file: /etc/quobyte/client.cfg Feb 27 12:27:14 devstack quobyte-client[83106]: Invalid parameters found, error: missing mount point. Feb 27 12:27:14 devstack quobyte-client[83106]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Feb 27 12:27:14 devstack quobyte-client[83106]: Failed to parse all commandline parameters, please use -h/--help to see available options. Feb 27 12:27:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-17493aef-07e3-4663-bad0-933fab33681d None None] CMD "mount.quobyte" returned: 1 in 0.106s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:27:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:27:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:27:14 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:27:14 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:27:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:27:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:27:14 devstack sudo[83108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:27:14 devstack sudo[83108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:27:15 devstack sudo[83108]: pam_unix(sudo:session): session closed for user root Feb 27 12:27:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-17493aef-07e3-4663-bad0-933fab33681d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.555s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:27:15 devstack cinder-volume[83077]: INFO cinder.volume.driver [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Driver hasn't implemented _init_vendor_properties() Feb 27 12:27:15 devstack cinder-volume[83077]: DEBUG cinder.volume.driver [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580642700195, 'free_capacity_gb': 1775.7580642700195, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83077) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 27 12:27:15 devstack cinder-volume[83077]: DEBUG oslo_db.sqlalchemy.engines [None req-17493aef-07e3-4663-bad0-933fab33681d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83077) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 12:27:15 devstack cinder-volume[83077]: DEBUG dbcounter [-] [83077] Writer thread running {{(pid=83077) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 12:27:15 devstack cinder-volume[83077]: DEBUG cinder.db.sqlalchemy.api [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Building query based on filter {{(pid=83077) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 27 12:27:15 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83077) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 27 12:27:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:27:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:27:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:27:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:27:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:27:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:27:15 devstack cinder-volume[83077]: INFO cinder.keymgr.migration [None req-e148fd20-bdaf-4d7f-b2ee-4a5974b04b87 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 27 12:27:15 devstack sudo[83155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:27:15 devstack sudo[83155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:27:15 devstack sudo[83155]: pam_unix(sudo:session): session closed for user root Feb 27 12:27:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-17493aef-07e3-4663-bad0-933fab33681d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.607s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:27:15 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:27:15 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Driver initialization completed successfully. Feb 27 12:27:15 devstack cinder-volume[83077]: INFO cinder.manager [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Initiating service 3 cleanup Feb 27 12:27:15 devstack cinder-volume[83077]: INFO cinder.manager [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Service 3 cleanup completed. Feb 27 12:27:15 devstack cinder-volume[83077]: DEBUG cinder.service [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Creating RPC server for service cinder-volume {{(pid=83077) start /opt/stack/cinder/cinder/service.py:231}} Feb 27 12:27:15 devstack cinder-volume[83077]: DEBUG cinder.service [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83077) start /opt/stack/cinder/cinder/service.py:237}} Feb 27 12:27:15 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Feb 27 12:27:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:27:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:27:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:27:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:27:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:27:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:27:15 devstack sudo[83186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:27:15 devstack sudo[83186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:27:16 devstack sudo[83186]: pam_unix(sudo:session): session closed for user root Feb 27 12:27:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-17493aef-07e3-4663-bad0-933fab33681d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.537s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:27:16 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-17493aef-07e3-4663-bad0-933fab33681d None None] Driver post RPC initialization completed successfully. Feb 27 12:27:24 devstack cinder-volume[82931]: DEBUG dbcounter [-] [82931] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82931) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:27:25 devstack cinder-volume[83077]: DEBUG dbcounter [-] [83077] Writing DB stats cinder:SELECT=2 {{(pid=83077) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:27:26 devstack cinder-volume[83077]: DEBUG dbcounter [-] [83077] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=83077) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:28:15 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-709d8d82-809e-4e70-9311-742cba12b469 tempest-GroupSnapshotsTest-1932635372 None] Group tempest-GroupSnapshotsTest-Group-26919309: creating Feb 27 12:28:15 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-709d8d82-809e-4e70-9311-742cba12b469 tempest-GroupSnapshotsTest-1932635372 None] Group tempest-GroupSnapshotsTest-Group-26919309: created successfully Feb 27 12:28:15 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-709d8d82-809e-4e70-9311-742cba12b469 tempest-GroupSnapshotsTest-1932635372 None] Create group completed successfully. Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Flow 'volume_create_manager' (a6afb8ac-92aa-4bf3-ac6d-9162c8f2f9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a61e2eb-bf2c-41c0-9a44-1296120cce75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a61e2eb-bf2c-41c0-9a44-1296120cce75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-765542753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ca8f0f3-7a1c-4e99-939b-a1008c09242f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1d2b12bc2e4d4c44be24a28724ad2e8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:28:16Z,use_quota=True,user_id='5954973666ad4aaeb0b4cef32e7c99d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (390a9487-20bb-4db1-9e21-fbba572dcab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (390a9487-20bb-4db1-9e21-fbba572dcab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d36c90-ea43-43cc-91f3-cb4121fd6781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d36c90-ea43-43cc-91f3-cb4121fd6781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ca8f0f3-7a1c-4e99-939b-a1008c09242f', 'volume_name': 'volume-3ca8f0f3-7a1c-4e99-939b-a1008c09242f', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f4aeec-8afc-401f-ba43-e5d750de7672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f4aeec-8afc-401f-ba43-e5d750de7672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c027a21-bcbd-42d1-8d59-2972e688ed8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:16 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Volume 3ca8f0f3-7a1c-4e99-939b-a1008c09242f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ca8f0f3-7a1c-4e99-939b-a1008c09242f', 'volume_size': 1} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-765542753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ca8f0f3-7a1c-4e99-939b-a1008c09242f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1d2b12bc2e4d4c44be24a28724ad2e8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:28:16Z,use_quota=True,user_id='5954973666ad4aaeb0b4cef32e7c99d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Creating volume 3ca8f0f3-7a1c-4e99-939b-a1008c09242f {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:28:16 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-3ca8f0f3-7a1c-4e99-939b-a1008c09242f 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Flow 'volume_create_manager' (b2072349-8769-49fd-8943-0a33731e88d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32b3dbf-64a0-4bad-af66-55894b8a76a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:16 devstack sudo[83420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-3ca8f0f3-7a1c-4e99-939b-a1008c09242f 1073741824 Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32b3dbf-64a0-4bad-af66-55894b8a76a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-51053244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=821120da-dc47-43dd-accf-e7ac291beabb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ab0267c781480c899a70b457e0c628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:28:16Z,use_quota=True,user_id='bcbc88c5bcc64332919b4ecd4650c03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:16 devstack sudo[83420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef1b23bc-6983-4e84-8499-72dd73d39b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef1b23bc-6983-4e84-8499-72dd73d39b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8548e849-9763-4c7c-b120-5c84f4a9b6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8548e849-9763-4c7c-b120-5c84f4a9b6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '821120da-dc47-43dd-accf-e7ac291beabb', 'volume_name': 'volume-821120da-dc47-43dd-accf-e7ac291beabb', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90a9a384-9a45-4e22-88c3-36791d3fe7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90a9a384-9a45-4e22-88c3-36791d3fe7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5322a173-f3af-4edf-b038-fec2ed3c8087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:16 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Volume 821120da-dc47-43dd-accf-e7ac291beabb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-821120da-dc47-43dd-accf-e7ac291beabb', 'volume_size': 1} Feb 27 12:28:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:17 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:28:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Flow 'volume_create_manager' (7698d6ca-88bb-4cbe-9133-5c413f5dd974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:28:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3e7660-d7bc-48bf-b523-a6351208d22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3e7660-d7bc-48bf-b523-a6351208d22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-457731348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ff9807a-4ab0-41ca-827a-927e867a4996,host='devstack@QuobyteHD#QuobyteHD',id=b0dbb375-83c7-4368-951d-dc766f881374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56278194745946eea7d8b1ee011abce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:28:17Z,use_quota=True,user_id='31ea13b75a134b1190251920fb03c0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3de644-d6d2-4dac-b901-c14059250874),volume_type_id=fd3de644-d6d2-4dac-b901-c14059250874)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67777dbb-b818-441e-a735-a2f0bd854d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67777dbb-b818-441e-a735-a2f0bd854d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13564580-c8f5-45b8-b47e-ebc584d26139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13564580-c8f5-45b8-b47e-ebc584d26139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0dbb375-83c7-4368-951d-dc766f881374', 'volume_name': 'volume-b0dbb375-83c7-4368-951d-dc766f881374', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6642bd96-4f41-4856-a0be-570b98e81bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6642bd96-4f41-4856-a0be-570b98e81bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2e8112-7d98-4523-aa72-61017d209743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:17 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Volume b0dbb375-83c7-4368-951d-dc766f881374: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0dbb375-83c7-4368-951d-dc766f881374', 'volume_size': 1} Feb 27 12:28:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:17 devstack sudo[83420]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-3ca8f0f3-7a1c-4e99-939b-a1008c09242f 1073741824" returned: 0 in 0.933s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-3ca8f0f3-7a1c-4e99-939b-a1008c09242f {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:17 devstack sudo[83739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-3ca8f0f3-7a1c-4e99-939b-a1008c09242f Feb 27 12:28:17 devstack sudo[83739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:18 devstack sudo[83739]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-3ca8f0f3-7a1c-4e99-939b-a1008c09242f" returned: 0 in 0.433s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.255s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-51053244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=821120da-dc47-43dd-accf-e7ac291beabb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ab0267c781480c899a70b457e0c628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:28:16Z,use_quota=True,user_id='bcbc88c5bcc64332919b4ecd4650c03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Creating volume 821120da-dc47-43dd-accf-e7ac291beabb {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:28:18 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-821120da-dc47-43dd-accf-e7ac291beabb 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c027a21-bcbd-42d1-8d59-2972e688ed8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ca8f0f3-7a1c-4e99-939b-a1008c09242f', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d22720b0-e5bc-40a8-b07d-f97473091481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:18 devstack sudo[83742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-821120da-dc47-43dd-accf-e7ac291beabb 1073741824 Feb 27 12:28:18 devstack sudo[83742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:18 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Volume volume-3ca8f0f3-7a1c-4e99-939b-a1008c09242f (3ca8f0f3-7a1c-4e99-939b-a1008c09242f): created successfully Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d22720b0-e5bc-40a8-b07d-f97473091481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Flow 'volume_create_manager' (a6afb8ac-92aa-4bf3-ac6d-9162c8f2f9f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:28:18 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-d11d4a88-af52-4533-9654-1c0f173bfce2 tempest-VolumesTestJSON-2012334940 None] Created volume successfully. Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:28:18 devstack sudo[83742]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Flow 'volume_create_manager' (20260e8e-8331-4a43-bed5-19fe1be95e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a211eaaa-7d00-4d3a-8481-c9fd83e322c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-821120da-dc47-43dd-accf-e7ac291beabb 1073741824" returned: 0 in 0.631s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a211eaaa-7d00-4d3a-8481-c9fd83e322c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1346794587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa4f5d6-754d-4aff-9c08-5807af89267e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1d2b12bc2e4d4c44be24a28724ad2e8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:28:19Z,use_quota=True,user_id='5954973666ad4aaeb0b4cef32e7c99d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d8a6db-ce3b-4a8d-83f2-6d210e094073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d8a6db-ce3b-4a8d-83f2-6d210e094073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba36eee2-a800-4a49-ad6e-3f0d248bc998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba36eee2-a800-4a49-ad6e-3f0d248bc998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aa4f5d6-754d-4aff-9c08-5807af89267e', 'volume_name': 'volume-7aa4f5d6-754d-4aff-9c08-5807af89267e', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91634690-f2e4-4fc6-a11d-92c8192c72bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91634690-f2e4-4fc6-a11d-92c8192c72bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554c145a-7631-4b7a-8f30-e8359af5b2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:18 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Volume 7aa4f5d6-754d-4aff-9c08-5807af89267e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aa4f5d6-754d-4aff-9c08-5807af89267e', 'volume_size': 1} Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-821120da-dc47-43dd-accf-e7ac291beabb {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:18 devstack sudo[83760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-821120da-dc47-43dd-accf-e7ac291beabb Feb 27 12:28:18 devstack sudo[83760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:19 devstack sudo[83760]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-821120da-dc47-43dd-accf-e7ac291beabb" returned: 0 in 0.408s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:28:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.936s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2ff9807a-4ab0-41ca-827a-927e867a4996,created_at=2026-02-27T11:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-457731348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ff9807a-4ab0-41ca-827a-927e867a4996,host='devstack@QuobyteHD#QuobyteHD',id=b0dbb375-83c7-4368-951d-dc766f881374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56278194745946eea7d8b1ee011abce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:28:17Z,use_quota=True,user_id='31ea13b75a134b1190251920fb03c0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3de644-d6d2-4dac-b901-c14059250874),volume_type_id=fd3de644-d6d2-4dac-b901-c14059250874)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:28:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Creating volume b0dbb375-83c7-4368-951d-dc766f881374 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:28:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:28:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:28:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:28:19 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:28:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5322a173-f3af-4edf-b038-fec2ed3c8087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-821120da-dc47-43dd-accf-e7ac291beabb', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:19 devstack sudo[83764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374 1073741824 Feb 27 12:28:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77dcce7-bbda-4f62-8eab-13af67f674a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:19 devstack sudo[83764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:19 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Volume volume-821120da-dc47-43dd-accf-e7ac291beabb (821120da-dc47-43dd-accf-e7ac291beabb): created successfully Feb 27 12:28:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77dcce7-bbda-4f62-8eab-13af67f674a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Flow 'volume_create_manager' (b2072349-8769-49fd-8943-0a33731e88d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:28:19 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-1e33e064-75eb-4dc9-8e71-29cf77fcc205 tempest-DeleteServersTestJSON-654972149 None] Created volume successfully. Feb 27 12:28:19 devstack sudo[83764]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374 1073741824" returned: 0 in 0.557s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:19 devstack sudo[83769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374 Feb 27 12:28:19 devstack sudo[83769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:20 devstack sudo[83769]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374" returned: 0 in 0.456s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:20 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:28:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.476s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:20 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1346794587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa4f5d6-754d-4aff-9c08-5807af89267e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1d2b12bc2e4d4c44be24a28724ad2e8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:28:19Z,use_quota=True,user_id='5954973666ad4aaeb0b4cef32e7c99d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:28:20 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Creating volume 7aa4f5d6-754d-4aff-9c08-5807af89267e {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:28:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:20 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:28:20 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:28:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:20 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:28:20 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:28:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7aa4f5d6-754d-4aff-9c08-5807af89267e 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:20 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2e8112-7d98-4523-aa72-61017d209743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0dbb375-83c7-4368-951d-dc766f881374', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:20 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b942dbf9-627a-4cfd-8e8c-19afd659fbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:20 devstack sudo[83773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7aa4f5d6-754d-4aff-9c08-5807af89267e 1073741824 Feb 27 12:28:20 devstack sudo[83773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:20 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Volume volume-b0dbb375-83c7-4368-951d-dc766f881374 (b0dbb375-83c7-4368-951d-dc766f881374): created successfully Feb 27 12:28:20 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b942dbf9-627a-4cfd-8e8c-19afd659fbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:20 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Flow 'volume_create_manager' (7698d6ca-88bb-4cbe-9133-5c413f5dd974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:28:20 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-ec238e7c-f1da-42ca-ad10-a4334958957a tempest-GroupSnapshotsTest-1932635372 None] Created volume successfully. Feb 27 12:28:20 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-a8045db3-5087-40ea-ae8d-c6692492d7f5 tempest-GroupSnapshotsTest-1932635372 None] GroupSnapshot 57d8db36-13f0-4b07-bdd6-26937be150bc: creating. Feb 27 12:28:20 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a8045db3-5087-40ea-ae8d-c6692492d7f5 tempest-GroupSnapshotsTest-1932635372 None] Group snapshot 57d8db36-13f0-4b07-bdd6-26937be150bc: creating. {{(pid=83077) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 12:28:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a8045db3-5087-40ea-ae8d-c6692492d7f5 tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:20 devstack sudo[83773]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7aa4f5d6-754d-4aff-9c08-5807af89267e 1073741824" returned: 0 in 0.566s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7aa4f5d6-754d-4aff-9c08-5807af89267e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:20 devstack sudo[83779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7aa4f5d6-754d-4aff-9c08-5807af89267e Feb 27 12:28:20 devstack sudo[83779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:21 devstack sudo[83779]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7aa4f5d6-754d-4aff-9c08-5807af89267e" returned: 0 in 0.444s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:21 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:28:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a8045db3-5087-40ea-ae8d-c6692492d7f5 tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.628s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554c145a-7631-4b7a-8f30-e8359af5b2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aa4f5d6-754d-4aff-9c08-5807af89267e', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df8a3f7d-5e0f-46cd-8076-9af84d4f5ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:21 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-a8045db3-5087-40ea-ae8d-c6692492d7f5 tempest-GroupSnapshotsTest-1932635372 None] Creating offline snapshot 6705bba1-0c6c-47c7-9c8c-c839d9475992 of volume b0dbb375-83c7-4368-951d-dc766f881374 {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:28:21 devstack cinder-volume[83077]: INFO oslo.privsep.daemon [None req-a8045db3-5087-40ea-ae8d-c6692492d7f5 tempest-GroupSnapshotsTest-1932635372 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp0d_2hstq/privsep.sock'] Feb 27 12:28:21 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Volume volume-7aa4f5d6-754d-4aff-9c08-5807af89267e (7aa4f5d6-754d-4aff-9c08-5807af89267e): created successfully Feb 27 12:28:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df8a3f7d-5e0f-46cd-8076-9af84d4f5ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:21 devstack sudo[83782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp0d_2hstq/privsep.sock Feb 27 12:28:21 devstack sudo[83782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Flow 'volume_create_manager' (20260e8e-8331-4a43-bed5-19fe1be95e9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:28:21 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-ab087e27-7c40-408b-879a-ce1d5055caad tempest-VolumesTestJSON-2012334940 None] Created volume successfully. Feb 27 12:28:22 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:28:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Flow 'volume_create_manager' (fefb6609-dc5f-4531-a0c6-96e23ff07a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:28:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0958d354-5558-4105-b4a4-88577e2894af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0958d354-5558-4105-b4a4-88577e2894af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-853635292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e2259f-b427-4872-bfde-d7176ad6d3cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1d2b12bc2e4d4c44be24a28724ad2e8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:28:22Z,use_quota=True,user_id='5954973666ad4aaeb0b4cef32e7c99d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b3f6e6d-5311-4328-9698-8154d4139b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b3f6e6d-5311-4328-9698-8154d4139b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d22589-dff5-47e1-8f0d-ca9516b44f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d22589-dff5-47e1-8f0d-ca9516b44f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6e2259f-b427-4872-bfde-d7176ad6d3cf', 'volume_name': 'volume-e6e2259f-b427-4872-bfde-d7176ad6d3cf', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2cba41-b00c-4c7a-a978-23939a816cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2cba41-b00c-4c7a-a978-23939a816cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19954a4f-f338-44bc-b1a5-a1de1fc3ea55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:22 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Volume e6e2259f-b427-4872-bfde-d7176ad6d3cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6e2259f-b427-4872-bfde-d7176ad6d3cf', 'volume_size': 1} Feb 27 12:28:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:22 devstack sudo[83782]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:22 devstack cinder-volume[83077]: INFO oslo.privsep.daemon [None req-a8045db3-5087-40ea-ae8d-c6692492d7f5 tempest-GroupSnapshotsTest-1932635372 None] Spawned new privsep daemon via rootwrap Feb 27 12:28:22 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [None req-a8045db3-5087-40ea-ae8d-c6692492d7f5 tempest-GroupSnapshotsTest-1932635372 None] Accepted privsep connection to /tmp/tmp0d_2hstq/privsep.sock {{(pid=83077) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Feb 27 12:28:22 devstack cinder-volume[83077]: INFO oslo.privsep.daemon [-] privsep daemon starting Feb 27 12:28:22 devstack cinder-volume[83077]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Feb 27 12:28:22 devstack cinder-volume[83077]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Feb 27 12:28:22 devstack cinder-volume[83077]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83785 Feb 27 12:28:22 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad27861-12cb-417e-a19d-caf5b6d78065]: (2,) {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:28:22 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[7570ddf7-bdfb-499b-bf9c-6cbbf819b790]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:28:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a8045db3-5087-40ea-ae8d-c6692492d7f5 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:22 devstack sudo[83787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374 Feb 27 12:28:22 devstack sudo[83787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:22 devstack sudo[83787]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a8045db3-5087-40ea-ae8d-c6692492d7f5 tempest-GroupSnapshotsTest-1932635372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374" returned: 0 in 0.499s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a8045db3-5087-40ea-ae8d-c6692492d7f5 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.6705bba1-0c6c-47c7-9c8c-c839d9475992 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:22 devstack sudo[83792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.6705bba1-0c6c-47c7-9c8c-c839d9475992 1G Feb 27 12:28:22 devstack sudo[83792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:23 devstack sudo[83792]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a8045db3-5087-40ea-ae8d-c6692492d7f5 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.6705bba1-0c6c-47c7-9c8c-c839d9475992 1G" returned: 0 in 0.652s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a8045db3-5087-40ea-ae8d-c6692492d7f5 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0dbb375-83c7-4368-951d-dc766f881374 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.6705bba1-0c6c-47c7-9c8c-c839d9475992 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:23 devstack sudo[83801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0dbb375-83c7-4368-951d-dc766f881374 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.6705bba1-0c6c-47c7-9c8c-c839d9475992 Feb 27 12:28:23 devstack sudo[83801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:24 devstack sudo[83801]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a8045db3-5087-40ea-ae8d-c6692492d7f5 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0dbb375-83c7-4368-951d-dc766f881374 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.6705bba1-0c6c-47c7-9c8c-c839d9475992" returned: 0 in 0.696s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:24 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-a8045db3-5087-40ea-ae8d-c6692492d7f5 tempest-GroupSnapshotsTest-1932635372 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.6705bba1-0c6c-47c7-9c8c-c839d9475992 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 12:28:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a8045db3-5087-40ea-ae8d-c6692492d7f5 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.6705bba1-0c6c-47c7-9c8c-c839d9475992 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:24 devstack sudo[83807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.6705bba1-0c6c-47c7-9c8c-c839d9475992 Feb 27 12:28:24 devstack sudo[83807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:24 devstack sudo[83807]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a8045db3-5087-40ea-ae8d-c6692492d7f5 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.6705bba1-0c6c-47c7-9c8c-c839d9475992" returned: 0 in 0.484s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:24 devstack cinder-volume[83077]: WARNING py.warnings [req-5011d8f1-5b18-42ae-882b-1d49ec5374d5 req-86b922cd-a85e-47af-9fba-0d226fb108fb tempest-DeleteServersTestJSON-654972149 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Feb 27 12:28:24 devstack cinder-volume[83077]: .first() Feb 27 12:28:24 devstack cinder-volume[83077]: Feb 27 12:28:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a8045db3-5087-40ea-ae8d-c6692492d7f5 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:24 devstack sudo[83825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.info Feb 27 12:28:24 devstack sudo[83825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-5011d8f1-5b18-42ae-882b-1d49ec5374d5 req-86b922cd-a85e-47af-9fba-0d226fb108fb tempest-DeleteServersTestJSON-654972149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:25 devstack sudo[83825]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a8045db3-5087-40ea-ae8d-c6692492d7f5 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.info" returned: 0 in 0.428s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:25 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-a8045db3-5087-40ea-ae8d-c6692492d7f5 tempest-GroupSnapshotsTest-1932635372 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 12:28:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a8045db3-5087-40ea-ae8d-c6692492d7f5 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:25 devstack sudo[83839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.info Feb 27 12:28:25 devstack sudo[83839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:25 devstack sudo[83839]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a8045db3-5087-40ea-ae8d-c6692492d7f5 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.info" returned: 0 in 0.401s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a8045db3-5087-40ea-ae8d-c6692492d7f5 tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.394s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.488s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:25 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-853635292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e2259f-b427-4872-bfde-d7176ad6d3cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1d2b12bc2e4d4c44be24a28724ad2e8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:28:22Z,use_quota=True,user_id='5954973666ad4aaeb0b4cef32e7c99d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:28:25 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Creating volume e6e2259f-b427-4872-bfde-d7176ad6d3cf {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:28:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:25 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:28:25 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:28:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:25 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:28:25 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:28:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e6e2259f-b427-4872-bfde-d7176ad6d3cf 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:25 devstack sudo[83876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e6e2259f-b427-4872-bfde-d7176ad6d3cf 1073741824 Feb 27 12:28:25 devstack sudo[83876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:25 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-a8045db3-5087-40ea-ae8d-c6692492d7f5 tempest-GroupSnapshotsTest-1932635372 None] group_snapshot 57d8db36-13f0-4b07-bdd6-26937be150bc: created successfully Feb 27 12:28:26 devstack sudo[83876]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e6e2259f-b427-4872-bfde-d7176ad6d3cf 1073741824" returned: 0 in 0.536s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e6e2259f-b427-4872-bfde-d7176ad6d3cf {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:26 devstack sudo[83888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e6e2259f-b427-4872-bfde-d7176ad6d3cf Feb 27 12:28:26 devstack sudo[83888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:26 devstack sudo[83888]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e6e2259f-b427-4872-bfde-d7176ad6d3cf" returned: 0 in 0.456s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:28:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-5011d8f1-5b18-42ae-882b-1d49ec5374d5 req-86b922cd-a85e-47af-9fba-0d226fb108fb tempest-DeleteServersTestJSON-654972149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.860s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:26 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbd2413-5ded-4f98-b23b-18518c34da4a]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:28:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-5011d8f1-5b18-42ae-882b-1d49ec5374d5 req-86b922cd-a85e-47af-9fba-0d226fb108fb tempest-DeleteServersTestJSON-654972149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-821120da-dc47-43dd-accf-e7ac291beabb {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19954a4f-f338-44bc-b1a5-a1de1fc3ea55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6e2259f-b427-4872-bfde-d7176ad6d3cf', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d957f5a1-8fbe-45d7-a836-394cb932d103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:26 devstack sudo[83891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-821120da-dc47-43dd-accf-e7ac291beabb Feb 27 12:28:26 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Volume volume-e6e2259f-b427-4872-bfde-d7176ad6d3cf (e6e2259f-b427-4872-bfde-d7176ad6d3cf): created successfully Feb 27 12:28:26 devstack sudo[83891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d957f5a1-8fbe-45d7-a836-394cb932d103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Flow 'volume_create_manager' (fefb6609-dc5f-4531-a0c6-96e23ff07a9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:28:26 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-7e3bb636-9c09-43bf-8e82-3c9271752979 tempest-VolumesTestJSON-2012334940 None] Created volume successfully. Feb 27 12:28:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:27 devstack sudo[83891]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-5011d8f1-5b18-42ae-882b-1d49ec5374d5 req-86b922cd-a85e-47af-9fba-0d226fb108fb tempest-DeleteServersTestJSON-654972149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-821120da-dc47-43dd-accf-e7ac291beabb" returned: 0 in 0.500s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-5011d8f1-5b18-42ae-882b-1d49ec5374d5 req-86b922cd-a85e-47af-9fba-0d226fb108fb tempest-DeleteServersTestJSON-654972149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.530s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.413s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "cinder-quobyte-6705bba1-0c6c-47c7-9c8c-c839d9475992-92a1b84e-6677-4fa8-af68-15d34c8e0f7b" by "_create_volume_from_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-6705bba1-0c6c-47c7-9c8c-c839d9475992-92a1b84e-6677-4fa8-af68-15d34c8e0f7b" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Creating volume 92a1b84e-6677-4fa8-af68-15d34c8e0f7b from snapshot 6705bba1-0c6c-47c7-9c8c-c839d9475992 {{(pid=83077) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "cinder-quobyte-92a1b84e-6677-4fa8-af68-15d34c8e0f7b" by "_copy_volume_from_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-5011d8f1-5b18-42ae-882b-1d49ec5374d5 req-86b922cd-a85e-47af-9fba-0d226fb108fb tempest-DeleteServersTestJSON-654972149 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84', 'name': 'volume-821120da-dc47-43dd-accf-e7ac291beabb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '483321d2-0f97-4828-b84e-69cd84035d57', 'enforce_multipath': True} {{(pid=83077) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-92a1b84e-6677-4fa8-af68-15d34c8e0f7b" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] snapshot: 6705bba1-0c6c-47c7-9c8c-c839d9475992, volume: 92a1b84e-6677-4fa8-af68-15d34c8e0f7b, {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc621a2-6a4c-407b-91c9-6556c9fc61c0]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.6705bba1-0c6c-47c7-9c8c-c839d9475992 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:27 devstack cinder-volume[83077]: INFO cinder.volume.manager [req-5011d8f1-5b18-42ae-882b-1d49ec5374d5 req-86b922cd-a85e-47af-9fba-0d226fb108fb tempest-DeleteServersTestJSON-654972149 None] attachment_update completed successfully. Feb 27 12:28:27 devstack sudo[83896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.6705bba1-0c6c-47c7-9c8c-c839d9475992 Feb 27 12:28:27 devstack sudo[83896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:27 devstack sudo[83896]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.6705bba1-0c6c-47c7-9c8c-c839d9475992" returned: 0 in 0.531s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0dbb375-83c7-4368-951d-dc766f881374(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374 {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Creating direct copy from snapshot {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9abf8b-6d32-4817-8da2-3b64f43d4b07]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:28:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:28 devstack sudo[83905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374 Feb 27 12:28:28 devstack sudo[83905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:28 devstack sudo[83905]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374" returned: 0 in 0.569s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:28 devstack cinder-volume[83077]: DEBUG cinder.utils [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Path /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-92a1b84e-6677-4fa8-af68-15d34c8e0f7b not found in is_blk_device check {{(pid=83077) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 12:28:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-92a1b84e-6677-4fa8-af68-15d34c8e0f7b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:28 devstack sudo[83979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-92a1b84e-6677-4fa8-af68-15d34c8e0f7b Feb 27 12:28:28 devstack sudo[83979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:28 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-578af07f-cdf5-4f72-b9c5-102a101199ae tempest-VolumesTestJSON-2012334940 None] Acquiring lock "cinder-e6e2259f-b427-4872-bfde-d7176ad6d3cf-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:28:28 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-578af07f-cdf5-4f72-b9c5-102a101199ae tempest-VolumesTestJSON-2012334940 None] Lock "cinder-e6e2259f-b427-4872-bfde-d7176ad6d3cf-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:28:28 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-578af07f-cdf5-4f72-b9c5-102a101199ae tempest-VolumesTestJSON-2012334940 None] Acquiring lock "cinder-quobyte-e6e2259f-b427-4872-bfde-d7176ad6d3cf" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:28:28 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-578af07f-cdf5-4f72-b9c5-102a101199ae tempest-VolumesTestJSON-2012334940 None] Lock "cinder-quobyte-e6e2259f-b427-4872-bfde-d7176ad6d3cf" acquired by "delete_volume" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:28:28 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[152ba610-4956-4bf9-b98d-2366ba80ab89]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:28:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-578af07f-cdf5-4f72-b9c5-102a101199ae tempest-VolumesTestJSON-2012334940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e6e2259f-b427-4872-bfde-d7176ad6d3cf {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:28 devstack sudo[83994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e6e2259f-b427-4872-bfde-d7176ad6d3cf Feb 27 12:28:28 devstack sudo[83994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:29 devstack sudo[83994]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-578af07f-cdf5-4f72-b9c5-102a101199ae tempest-VolumesTestJSON-2012334940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e6e2259f-b427-4872-bfde-d7176ad6d3cf" returned: 0 in 0.944s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-578af07f-cdf5-4f72-b9c5-102a101199ae tempest-VolumesTestJSON-2012334940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e6e2259f-b427-4872-bfde-d7176ad6d3cf {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:29 devstack sudo[84353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e6e2259f-b427-4872-bfde-d7176ad6d3cf Feb 27 12:28:29 devstack sudo[84353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:30 devstack sudo[84353]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-578af07f-cdf5-4f72-b9c5-102a101199ae tempest-VolumesTestJSON-2012334940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e6e2259f-b427-4872-bfde-d7176ad6d3cf" returned: 0 in 1.016s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:30 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-578af07f-cdf5-4f72-b9c5-102a101199ae tempest-VolumesTestJSON-2012334940 None] Lock "cinder-quobyte-e6e2259f-b427-4872-bfde-d7176ad6d3cf" released by "delete_volume" :: held 1.993s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:28:30 devstack cinder-volume[83077]: WARNING cinder.quota [None req-578af07f-cdf5-4f72-b9c5-102a101199ae tempest-VolumesTestJSON-2012334940 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:28:30 devstack cinder-volume[83077]: WARNING cinder.quota [None req-578af07f-cdf5-4f72-b9c5-102a101199ae tempest-VolumesTestJSON-2012334940 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:28:30 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-578af07f-cdf5-4f72-b9c5-102a101199ae tempest-VolumesTestJSON-2012334940 None] Created reservations ['7d744c73-b91f-40bc-bf7b-90eb86f00373', '6d23f693-43dc-44df-9655-af5d9327e477', 'b84f6992-075f-4f43-bb7b-8c2e185e0a90', '4294cc33-b605-4f80-8822-bca0f52792fa'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:28:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-578af07f-cdf5-4f72-b9c5-102a101199ae tempest-VolumesTestJSON-2012334940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-578af07f-cdf5-4f72-b9c5-102a101199ae tempest-VolumesTestJSON-2012334940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:30 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-578af07f-cdf5-4f72-b9c5-102a101199ae tempest-VolumesTestJSON-2012334940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:28:30 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-578af07f-cdf5-4f72-b9c5-102a101199ae tempest-VolumesTestJSON-2012334940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:28:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-578af07f-cdf5-4f72-b9c5-102a101199ae tempest-VolumesTestJSON-2012334940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-578af07f-cdf5-4f72-b9c5-102a101199ae tempest-VolumesTestJSON-2012334940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:30 devstack sudo[84358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:28:30 devstack sudo[84358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-76a314a5-8228-41a0-99d7-5c735b02e099 tempest-VolumesTestJSON-2012334940 None] Acquiring lock "cinder-7aa4f5d6-754d-4aff-9c08-5807af89267e-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:28:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-76a314a5-8228-41a0-99d7-5c735b02e099 tempest-VolumesTestJSON-2012334940 None] Lock "cinder-7aa4f5d6-754d-4aff-9c08-5807af89267e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:28:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-76a314a5-8228-41a0-99d7-5c735b02e099 tempest-VolumesTestJSON-2012334940 None] Acquiring lock "cinder-quobyte-7aa4f5d6-754d-4aff-9c08-5807af89267e" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:28:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-76a314a5-8228-41a0-99d7-5c735b02e099 tempest-VolumesTestJSON-2012334940 None] Lock "cinder-quobyte-7aa4f5d6-754d-4aff-9c08-5807af89267e" acquired by "delete_volume" :: waited 0.037s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:28:31 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a54802-bc11-41b9-85e0-9419f668fe1c]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:28:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-76a314a5-8228-41a0-99d7-5c735b02e099 tempest-VolumesTestJSON-2012334940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7aa4f5d6-754d-4aff-9c08-5807af89267e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:32 devstack sudo[84361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7aa4f5d6-754d-4aff-9c08-5807af89267e Feb 27 12:28:32 devstack sudo[84361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:32 devstack sudo[83979]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-92a1b84e-6677-4fa8-af68-15d34c8e0f7b" returned: 0 in 3.585s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:32 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da0b5bf-685a-4523-adf3-e91e204a0890]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:28:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:32 devstack sudo[84363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374 Feb 27 12:28:32 devstack sudo[84363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:32 devstack sudo[84358]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-578af07f-cdf5-4f72-b9c5-102a101199ae tempest-VolumesTestJSON-2012334940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 1.616s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:32 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-578af07f-cdf5-4f72-b9c5-102a101199ae tempest-VolumesTestJSON-2012334940 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:28:32 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-578af07f-cdf5-4f72-b9c5-102a101199ae tempest-VolumesTestJSON-2012334940 None] Deleted volume successfully. Feb 27 12:28:32 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-578af07f-cdf5-4f72-b9c5-102a101199ae tempest-VolumesTestJSON-2012334940 None] Lock "cinder-e6e2259f-b427-4872-bfde-d7176ad6d3cf-delete_volume" released by "delete_volume" :: held 3.848s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:28:32 devstack sudo[84361]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-76a314a5-8228-41a0-99d7-5c735b02e099 tempest-VolumesTestJSON-2012334940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7aa4f5d6-754d-4aff-9c08-5807af89267e" returned: 0 in 1.220s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-76a314a5-8228-41a0-99d7-5c735b02e099 tempest-VolumesTestJSON-2012334940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7aa4f5d6-754d-4aff-9c08-5807af89267e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:32 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:28:32 devstack sudo[84369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7aa4f5d6-754d-4aff-9c08-5807af89267e Feb 27 12:28:32 devstack sudo[84369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Flow 'volume_create_manager' (efce661b-641f-405c-97fa-033686e6e0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:28:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9c1381-ab03-4579-a4ca-edb33d2390a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9c1381-ab03-4579-a4ca-edb33d2390a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-749149044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9640dd83-73c6-4905-9a8b-846a3f0c94c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4ac23aa09d14198b65ca5ed841d486c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:28:33Z,use_quota=True,user_id='16be8545bb07470eb69a2c2f997243b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8818235f-0bc1-4bc1-9702-953f92d8f6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8818235f-0bc1-4bc1-9702-953f92d8f6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (474045f3-16d9-4fd6-9cfa-edac92830979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (474045f3-16d9-4fd6-9cfa-edac92830979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9640dd83-73c6-4905-9a8b-846a3f0c94c1', 'volume_name': 'volume-9640dd83-73c6-4905-9a8b-846a3f0c94c1', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ed9bfa-af72-496e-bd4a-c6369a3e2dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ed9bfa-af72-496e-bd4a-c6369a3e2dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72f4e4f4-1569-4ab9-9bca-3e59e69c8109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:32 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Volume 9640dd83-73c6-4905-9a8b-846a3f0c94c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9640dd83-73c6-4905-9a8b-846a3f0c94c1', 'volume_size': 1} Feb 27 12:28:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:33 devstack sudo[84363]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374" returned: 0 in 1.002s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Image conversion details: src /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374, size 1024.00 MB, duration 3.59 sec, destination /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-92a1b84e-6677-4fa8-af68-15d34c8e0f7b {{(pid=83077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:28:33 devstack cinder-volume[83077]: INFO cinder.image.image_utils [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Converted 1024.00 MB image at 285.54 MB/s Feb 27 12:28:33 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-92a1b84e-6677-4fa8-af68-15d34c8e0f7b is being set with open permissions: ugo+rw: NotImplementedError Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-92a1b84e-6677-4fa8-af68-15d34c8e0f7b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:33 devstack sudo[84374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-92a1b84e-6677-4fa8-af68-15d34c8e0f7b Feb 27 12:28:33 devstack sudo[84374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:33 devstack sudo[84369]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-76a314a5-8228-41a0-99d7-5c735b02e099 tempest-VolumesTestJSON-2012334940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7aa4f5d6-754d-4aff-9c08-5807af89267e" returned: 0 in 0.489s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-76a314a5-8228-41a0-99d7-5c735b02e099 tempest-VolumesTestJSON-2012334940 None] Lock "cinder-quobyte-7aa4f5d6-754d-4aff-9c08-5807af89267e" released by "delete_volume" :: held 1.771s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-76a314a5-8228-41a0-99d7-5c735b02e099 tempest-VolumesTestJSON-2012334940 None] Created reservations ['b71e03ab-812c-4ce1-8697-67bdfd9ad95e', '6c698d51-56f1-45a4-ae78-dd4abfafd8fb', 'bfe7f21d-5753-4fc2-a9db-47126356d7ce', '5d980c1e-0d2f-4d1c-b10a-172deacc5eed'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-76a314a5-8228-41a0-99d7-5c735b02e099 tempest-VolumesTestJSON-2012334940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-76a314a5-8228-41a0-99d7-5c735b02e099 tempest-VolumesTestJSON-2012334940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-76a314a5-8228-41a0-99d7-5c735b02e099 tempest-VolumesTestJSON-2012334940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-76a314a5-8228-41a0-99d7-5c735b02e099 tempest-VolumesTestJSON-2012334940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-76a314a5-8228-41a0-99d7-5c735b02e099 tempest-VolumesTestJSON-2012334940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-76a314a5-8228-41a0-99d7-5c735b02e099 tempest-VolumesTestJSON-2012334940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:33 devstack sudo[84378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:28:33 devstack sudo[84378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:33 devstack sudo[84374]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-92a1b84e-6677-4fa8-af68-15d34c8e0f7b" returned: 0 in 0.404s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-92a1b84e-6677-4fa8-af68-15d34c8e0f7b" released by "_copy_volume_from_snapshot" :: held 6.170s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-6705bba1-0c6c-47c7-9c8c-c839d9475992-92a1b84e-6677-4fa8-af68-15d34c8e0f7b" released by "_create_volume_from_snapshot" :: held 6.207s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.234s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.720s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-749149044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9640dd83-73c6-4905-9a8b-846a3f0c94c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4ac23aa09d14198b65ca5ed841d486c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:28:33Z,use_quota=True,user_id='16be8545bb07470eb69a2c2f997243b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Creating volume 9640dd83-73c6-4905-9a8b-846a3f0c94c1 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:28:33 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9640dd83-73c6-4905-9a8b-846a3f0c94c1 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:33 devstack sudo[84381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9640dd83-73c6-4905-9a8b-846a3f0c94c1 1073741824 Feb 27 12:28:33 devstack sudo[84381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a98814ab-1bd0-4c57-829a-2c83bcceef0a tempest-VolumesTestJSON-2012334940 None] Acquiring lock "cinder-3ca8f0f3-7a1c-4e99-939b-a1008c09242f-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a98814ab-1bd0-4c57-829a-2c83bcceef0a tempest-VolumesTestJSON-2012334940 None] Lock "cinder-3ca8f0f3-7a1c-4e99-939b-a1008c09242f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a98814ab-1bd0-4c57-829a-2c83bcceef0a tempest-VolumesTestJSON-2012334940 None] Acquiring lock "cinder-quobyte-3ca8f0f3-7a1c-4e99-939b-a1008c09242f" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:28:33 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-bb9d03e1-ea0e-4189-9317-f045e1041b1e tempest-GroupSnapshotsTest-1932635372 None] Create group from source-snapshot-57d8db36-13f0-4b07-bdd6-26937be150bc completed successfully. Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a98814ab-1bd0-4c57-829a-2c83bcceef0a tempest-VolumesTestJSON-2012334940 None] Lock "cinder-quobyte-3ca8f0f3-7a1c-4e99-939b-a1008c09242f" acquired by "delete_volume" :: waited 0.022s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:28:33 devstack sudo[84378]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-76a314a5-8228-41a0-99d7-5c735b02e099 tempest-VolumesTestJSON-2012334940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.489s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-76a314a5-8228-41a0-99d7-5c735b02e099 tempest-VolumesTestJSON-2012334940 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a3ed6b-3d9e-4b57-b1a5-eaaa277b9f6f]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a98814ab-1bd0-4c57-829a-2c83bcceef0a tempest-VolumesTestJSON-2012334940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-3ca8f0f3-7a1c-4e99-939b-a1008c09242f {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:33 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-76a314a5-8228-41a0-99d7-5c735b02e099 tempest-VolumesTestJSON-2012334940 None] Deleted volume successfully. Feb 27 12:28:33 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-76a314a5-8228-41a0-99d7-5c735b02e099 tempest-VolumesTestJSON-2012334940 None] Lock "cinder-7aa4f5d6-754d-4aff-9c08-5807af89267e-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:28:33 devstack sudo[84384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-3ca8f0f3-7a1c-4e99-939b-a1008c09242f Feb 27 12:28:33 devstack sudo[84384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:34 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d84e2140-d364-42df-9d68-3505cc8ef8c0 tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "cinder-quobyte-92a1b84e-6677-4fa8-af68-15d34c8e0f7b" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:28:34 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d84e2140-d364-42df-9d68-3505cc8ef8c0 tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-92a1b84e-6677-4fa8-af68-15d34c8e0f7b" acquired by "delete_volume" :: waited 0.012s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:28:34 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a9e760-babe-49c4-854c-3604f060852b]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:28:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d84e2140-d364-42df-9d68-3505cc8ef8c0 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-92a1b84e-6677-4fa8-af68-15d34c8e0f7b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:34 devstack sudo[84412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-92a1b84e-6677-4fa8-af68-15d34c8e0f7b Feb 27 12:28:34 devstack sudo[84412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:34 devstack sudo[84381]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9640dd83-73c6-4905-9a8b-846a3f0c94c1 1073741824" returned: 0 in 0.885s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9640dd83-73c6-4905-9a8b-846a3f0c94c1 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:34 devstack sudo[84414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9640dd83-73c6-4905-9a8b-846a3f0c94c1 Feb 27 12:28:34 devstack sudo[84414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:34 devstack sudo[84384]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a98814ab-1bd0-4c57-829a-2c83bcceef0a tempest-VolumesTestJSON-2012334940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-3ca8f0f3-7a1c-4e99-939b-a1008c09242f" returned: 0 in 0.975s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a98814ab-1bd0-4c57-829a-2c83bcceef0a tempest-VolumesTestJSON-2012334940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-3ca8f0f3-7a1c-4e99-939b-a1008c09242f {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:34 devstack sudo[84421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-3ca8f0f3-7a1c-4e99-939b-a1008c09242f Feb 27 12:28:34 devstack sudo[84421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:34 devstack sudo[84412]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d84e2140-d364-42df-9d68-3505cc8ef8c0 tempest-GroupSnapshotsTest-1932635372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-92a1b84e-6677-4fa8-af68-15d34c8e0f7b" returned: 0 in 0.743s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d84e2140-d364-42df-9d68-3505cc8ef8c0 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-92a1b84e-6677-4fa8-af68-15d34c8e0f7b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:34 devstack sudo[84451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-92a1b84e-6677-4fa8-af68-15d34c8e0f7b Feb 27 12:28:34 devstack sudo[84451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:35 devstack sudo[84414]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9640dd83-73c6-4905-9a8b-846a3f0c94c1" returned: 0 in 0.554s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72f4e4f4-1569-4ab9-9bca-3e59e69c8109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9640dd83-73c6-4905-9a8b-846a3f0c94c1', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1edb342-5587-4fb1-95cc-c97800a20331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:35 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Volume volume-9640dd83-73c6-4905-9a8b-846a3f0c94c1 (9640dd83-73c6-4905-9a8b-846a3f0c94c1): created successfully Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1edb342-5587-4fb1-95cc-c97800a20331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Flow 'volume_create_manager' (efce661b-641f-405c-97fa-033686e6e0cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:28:35 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-b3b1ef50-99ef-4d7b-b19b-1f83cf3bbf73 tempest-VolumesAdminNegativeTest-564759078 None] Created volume successfully. Feb 27 12:28:35 devstack sudo[84421]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a98814ab-1bd0-4c57-829a-2c83bcceef0a tempest-VolumesTestJSON-2012334940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-3ca8f0f3-7a1c-4e99-939b-a1008c09242f" returned: 0 in 0.475s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a98814ab-1bd0-4c57-829a-2c83bcceef0a tempest-VolumesTestJSON-2012334940 None] Lock "cinder-quobyte-3ca8f0f3-7a1c-4e99-939b-a1008c09242f" released by "delete_volume" :: held 1.478s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-a98814ab-1bd0-4c57-829a-2c83bcceef0a tempest-VolumesTestJSON-2012334940 None] Created reservations ['8c48f5e7-6267-48e7-9181-ca01bac6f645', 'bae1ef34-196f-478c-af53-020e1ff7a049', 'a747d21c-285c-4c7d-bbc6-c851d2f5dbf5', 'f48da1d8-9d7b-4e27-b2ae-5de68c9913f2'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a98814ab-1bd0-4c57-829a-2c83bcceef0a tempest-VolumesTestJSON-2012334940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a98814ab-1bd0-4c57-829a-2c83bcceef0a tempest-VolumesTestJSON-2012334940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a98814ab-1bd0-4c57-829a-2c83bcceef0a tempest-VolumesTestJSON-2012334940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a98814ab-1bd0-4c57-829a-2c83bcceef0a tempest-VolumesTestJSON-2012334940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a98814ab-1bd0-4c57-829a-2c83bcceef0a tempest-VolumesTestJSON-2012334940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a98814ab-1bd0-4c57-829a-2c83bcceef0a tempest-VolumesTestJSON-2012334940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:35 devstack sudo[84454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:28:35 devstack sudo[84454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:35 devstack sudo[84451]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d84e2140-d364-42df-9d68-3505cc8ef8c0 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-92a1b84e-6677-4fa8-af68-15d34c8e0f7b" returned: 0 in 0.512s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d84e2140-d364-42df-9d68-3505cc8ef8c0 tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-92a1b84e-6677-4fa8-af68-15d34c8e0f7b" released by "delete_volume" :: held 1.292s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-d84e2140-d364-42df-9d68-3505cc8ef8c0 tempest-GroupSnapshotsTest-1932635372 None] Created reservations ['ecf1eb34-87f6-4f3f-8b30-90b07c787b26'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:28:35 devstack cinder-volume[83077]: WARNING cinder.quota [None req-d84e2140-d364-42df-9d68-3505cc8ef8c0 tempest-GroupSnapshotsTest-1932635372 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-597743432 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-597743432, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:28:35 devstack cinder-volume[83077]: WARNING cinder.quota [None req-d84e2140-d364-42df-9d68-3505cc8ef8c0 tempest-GroupSnapshotsTest-1932635372 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-597743432 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-597743432, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-d84e2140-d364-42df-9d68-3505cc8ef8c0 tempest-GroupSnapshotsTest-1932635372 None] Created reservations ['a62adfdd-fd49-4b3c-acc2-0360d0c81aea', '67bd6bf4-dfe1-426a-a48e-84bc662397b5', 'dd73cef5-e208-4552-9621-f42aa34476a6', '31f1727f-7ccd-4e36-83c9-84e3e89a6eb9'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d84e2140-d364-42df-9d68-3505cc8ef8c0 tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d84e2140-d364-42df-9d68-3505cc8ef8c0 tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d84e2140-d364-42df-9d68-3505cc8ef8c0 tempest-GroupSnapshotsTest-1932635372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d84e2140-d364-42df-9d68-3505cc8ef8c0 tempest-GroupSnapshotsTest-1932635372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d84e2140-d364-42df-9d68-3505cc8ef8c0 tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d84e2140-d364-42df-9d68-3505cc8ef8c0 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:35 devstack sudo[84457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:28:35 devstack sudo[84457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:35 devstack sudo[84454]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a98814ab-1bd0-4c57-829a-2c83bcceef0a tempest-VolumesTestJSON-2012334940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.582s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-a98814ab-1bd0-4c57-829a-2c83bcceef0a tempest-VolumesTestJSON-2012334940 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:28:35 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-a98814ab-1bd0-4c57-829a-2c83bcceef0a tempest-VolumesTestJSON-2012334940 None] Deleted volume successfully. Feb 27 12:28:35 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a98814ab-1bd0-4c57-829a-2c83bcceef0a tempest-VolumesTestJSON-2012334940 None] Lock "cinder-3ca8f0f3-7a1c-4e99-939b-a1008c09242f-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:28:36 devstack sudo[84457]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d84e2140-d364-42df-9d68-3505cc8ef8c0 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.549s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:36 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-d84e2140-d364-42df-9d68-3505cc8ef8c0 tempest-GroupSnapshotsTest-1932635372 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:28:36 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-d84e2140-d364-42df-9d68-3505cc8ef8c0 tempest-GroupSnapshotsTest-1932635372 None] Delete group completed successfully. Feb 27 12:28:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bb8b1f7e-b386-40c1-8644-a5ef9d471ecd tempest-VolumesAdminNegativeTest-564759078 None] Acquiring lock "cinder-9640dd83-73c6-4905-9a8b-846a3f0c94c1-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:28:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bb8b1f7e-b386-40c1-8644-a5ef9d471ecd tempest-VolumesAdminNegativeTest-564759078 None] Lock "cinder-9640dd83-73c6-4905-9a8b-846a3f0c94c1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:28:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bb8b1f7e-b386-40c1-8644-a5ef9d471ecd tempest-VolumesAdminNegativeTest-564759078 None] Acquiring lock "cinder-quobyte-9640dd83-73c6-4905-9a8b-846a3f0c94c1" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:28:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bb8b1f7e-b386-40c1-8644-a5ef9d471ecd tempest-VolumesAdminNegativeTest-564759078 None] Lock "cinder-quobyte-9640dd83-73c6-4905-9a8b-846a3f0c94c1" acquired by "delete_volume" :: waited 0.006s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:28:36 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[867457b6-1534-416a-b9bf-064381c6c89d]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:28:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bb8b1f7e-b386-40c1-8644-a5ef9d471ecd tempest-VolumesAdminNegativeTest-564759078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9640dd83-73c6-4905-9a8b-846a3f0c94c1 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:36 devstack sudo[84462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9640dd83-73c6-4905-9a8b-846a3f0c94c1 Feb 27 12:28:36 devstack sudo[84462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:36 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-ae7a1b8e-6be3-41e4-bc7c-a0e3571f20fa tempest-GroupSnapshotsTest-1932635372 None] group_snapshot 57d8db36-13f0-4b07-bdd6-26937be150bc: deleting Feb 27 12:28:36 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ae7a1b8e-6be3-41e4-bc7c-a0e3571f20fa tempest-GroupSnapshotsTest-1932635372 None] group_snapshot 57d8db36-13f0-4b07-bdd6-26937be150bc: deleting {{(pid=83077) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 12:28:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-ae7a1b8e-6be3-41e4-bc7c-a0e3571f20fa tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "cinder-quobyte-b0dbb375-83c7-4368-951d-dc766f881374" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:28:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-ae7a1b8e-6be3-41e4-bc7c-a0e3571f20fa tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-b0dbb375-83c7-4368-951d-dc766f881374" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:28:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-ae7a1b8e-6be3-41e4-bc7c-a0e3571f20fa tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "cinder-quobyte-6705bba1-0c6c-47c7-9c8c-c839d9475992" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:28:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-ae7a1b8e-6be3-41e4-bc7c-a0e3571f20fa tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-6705bba1-0c6c-47c7-9c8c-c839d9475992" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:28:36 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-ae7a1b8e-6be3-41e4-bc7c-a0e3571f20fa tempest-GroupSnapshotsTest-1932635372 None] Deleting offline snapshot 6705bba1-0c6c-47c7-9c8c-c839d9475992 of volume b0dbb375-83c7-4368-951d-dc766f881374 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:28:36 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-ae7a1b8e-6be3-41e4-bc7c-a0e3571f20fa tempest-GroupSnapshotsTest-1932635372 None] snapshot_file for this snap is: volume-b0dbb375-83c7-4368-951d-dc766f881374.6705bba1-0c6c-47c7-9c8c-c839d9475992 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:28:36 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a38a1c6-8ef2-412c-9580-44faaa070ca9]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:28:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ae7a1b8e-6be3-41e4-bc7c-a0e3571f20fa tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.6705bba1-0c6c-47c7-9c8c-c839d9475992 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:36 devstack sudo[84464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.6705bba1-0c6c-47c7-9c8c-c839d9475992 Feb 27 12:28:36 devstack sudo[84464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:37 devstack sudo[84462]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bb8b1f7e-b386-40c1-8644-a5ef9d471ecd tempest-VolumesAdminNegativeTest-564759078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9640dd83-73c6-4905-9a8b-846a3f0c94c1" returned: 0 in 0.705s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bb8b1f7e-b386-40c1-8644-a5ef9d471ecd tempest-VolumesAdminNegativeTest-564759078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9640dd83-73c6-4905-9a8b-846a3f0c94c1 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:37 devstack sudo[84469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9640dd83-73c6-4905-9a8b-846a3f0c94c1 Feb 27 12:28:37 devstack sudo[84469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:37 devstack cinder-volume[83077]: INFO cinder.volume.manager [req-3f14a45b-52f9-4a8b-aefe-60f9ad060763 req-b14f7153-bf80-41c7-a760-7107b1c556ed tempest-DeleteServersTestJSON-654972149 None] Terminate volume connection completed successfully. Feb 27 12:28:37 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-3f14a45b-52f9-4a8b-aefe-60f9ad060763 req-b14f7153-bf80-41c7-a760-7107b1c556ed tempest-DeleteServersTestJSON-654972149 None] Deleting attachment 483321d2-0f97-4828-b84e-69cd84035d57. {{(pid=83077) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 27 12:28:37 devstack sudo[84464]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ae7a1b8e-6be3-41e4-bc7c-a0e3571f20fa tempest-GroupSnapshotsTest-1932635372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.6705bba1-0c6c-47c7-9c8c-c839d9475992" returned: 0 in 0.824s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:37 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-ae7a1b8e-6be3-41e4-bc7c-a0e3571f20fa tempest-GroupSnapshotsTest-1932635372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0dbb375-83c7-4368-951d-dc766f881374(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:28:37 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[37617627-4d8f-4add-becd-456880f52292]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:28:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ae7a1b8e-6be3-41e4-bc7c-a0e3571f20fa tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:37 devstack sudo[84474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374 Feb 27 12:28:37 devstack sudo[84474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:37 devstack sudo[84469]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bb8b1f7e-b386-40c1-8644-a5ef9d471ecd tempest-VolumesAdminNegativeTest-564759078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9640dd83-73c6-4905-9a8b-846a3f0c94c1" returned: 0 in 0.442s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:37 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bb8b1f7e-b386-40c1-8644-a5ef9d471ecd tempest-VolumesAdminNegativeTest-564759078 None] Lock "cinder-quobyte-9640dd83-73c6-4905-9a8b-846a3f0c94c1" released by "delete_volume" :: held 1.173s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:28:37 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-bb8b1f7e-b386-40c1-8644-a5ef9d471ecd tempest-VolumesAdminNegativeTest-564759078 None] Created reservations ['b68a25db-1af7-4cbe-8fa2-2976e38d59eb', 'fcf9e8f2-3db4-4f8b-b6ee-616fed89e22e', '7ca7a79f-6f8f-4193-b3bf-68410d1baa71', '5675fb40-9b74-4e25-9e93-70bc555e6755'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:28:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bb8b1f7e-b386-40c1-8644-a5ef9d471ecd tempest-VolumesAdminNegativeTest-564759078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bb8b1f7e-b386-40c1-8644-a5ef9d471ecd tempest-VolumesAdminNegativeTest-564759078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:37 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bb8b1f7e-b386-40c1-8644-a5ef9d471ecd tempest-VolumesAdminNegativeTest-564759078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:28:37 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bb8b1f7e-b386-40c1-8644-a5ef9d471ecd tempest-VolumesAdminNegativeTest-564759078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:28:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bb8b1f7e-b386-40c1-8644-a5ef9d471ecd tempest-VolumesAdminNegativeTest-564759078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bb8b1f7e-b386-40c1-8644-a5ef9d471ecd tempest-VolumesAdminNegativeTest-564759078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:37 devstack sudo[84477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:28:37 devstack sudo[84477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:38 devstack sudo[84474]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ae7a1b8e-6be3-41e4-bc7c-a0e3571f20fa tempest-GroupSnapshotsTest-1932635372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374" returned: 0 in 0.682s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ae7a1b8e-6be3-41e4-bc7c-a0e3571f20fa tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.6705bba1-0c6c-47c7-9c8c-c839d9475992 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:38 devstack sudo[84483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.6705bba1-0c6c-47c7-9c8c-c839d9475992 Feb 27 12:28:38 devstack sudo[84483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:38 devstack sudo[84477]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bb8b1f7e-b386-40c1-8644-a5ef9d471ecd tempest-VolumesAdminNegativeTest-564759078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.534s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:38 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-bb8b1f7e-b386-40c1-8644-a5ef9d471ecd tempest-VolumesAdminNegativeTest-564759078 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:28:38 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-bb8b1f7e-b386-40c1-8644-a5ef9d471ecd tempest-VolumesAdminNegativeTest-564759078 None] Deleted volume successfully. Feb 27 12:28:38 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bb8b1f7e-b386-40c1-8644-a5ef9d471ecd tempest-VolumesAdminNegativeTest-564759078 None] Lock "cinder-9640dd83-73c6-4905-9a8b-846a3f0c94c1-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:28:38 devstack sudo[84483]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ae7a1b8e-6be3-41e4-bc7c-a0e3571f20fa tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.6705bba1-0c6c-47c7-9c8c-c839d9475992" returned: 0 in 0.644s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ae7a1b8e-6be3-41e4-bc7c-a0e3571f20fa tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.6705bba1-0c6c-47c7-9c8c-c839d9475992 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:38 devstack sudo[84488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.6705bba1-0c6c-47c7-9c8c-c839d9475992 Feb 27 12:28:38 devstack sudo[84488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:38 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-c0f3f82f-2223-4ea6-ba12-8d241ee324bc tempest-GroupSnapshotsV319Test-358563587 None] Group tempest-GroupSnapshotsV319Test-Group-1408769653: creating Feb 27 12:28:38 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-c0f3f82f-2223-4ea6-ba12-8d241ee324bc tempest-GroupSnapshotsV319Test-358563587 None] Group tempest-GroupSnapshotsV319Test-Group-1408769653: created successfully Feb 27 12:28:38 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-c0f3f82f-2223-4ea6-ba12-8d241ee324bc tempest-GroupSnapshotsV319Test-358563587 None] Create group completed successfully. Feb 27 12:28:39 devstack sudo[84488]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ae7a1b8e-6be3-41e4-bc7c-a0e3571f20fa tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374.6705bba1-0c6c-47c7-9c8c-c839d9475992" returned: 0 in 0.513s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:39 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-ae7a1b8e-6be3-41e4-bc7c-a0e3571f20fa tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-6705bba1-0c6c-47c7-9c8c-c839d9475992" released by "_delete_snapshot" :: held 2.709s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:28:39 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-ae7a1b8e-6be3-41e4-bc7c-a0e3571f20fa tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-b0dbb375-83c7-4368-951d-dc766f881374" released by "delete_snapshot" :: held 2.719s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:28:39 devstack cinder-volume[83077]: WARNING cinder.quota [None req-ae7a1b8e-6be3-41e4-bc7c-a0e3571f20fa tempest-GroupSnapshotsTest-1932635372 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-597743432 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-597743432, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:28:39 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-ae7a1b8e-6be3-41e4-bc7c-a0e3571f20fa tempest-GroupSnapshotsTest-1932635372 None] Created reservations ['de5515f8-42df-47f4-80d1-e5e9bb57977b', '15a0072c-5efd-4420-b8a0-1a6b6a1d39b2', '2607e1e0-4526-48dd-8607-cb04a28d6590', '564c8a1c-bd73-4360-a175-aa6063695059'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:28:39 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-ae7a1b8e-6be3-41e4-bc7c-a0e3571f20fa tempest-GroupSnapshotsTest-1932635372 None] group_snapshot 57d8db36-13f0-4b07-bdd6-26937be150bc: deleted successfully Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4b882d4e-3598-4d8c-a345-06a15dcee07b tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "cinder-quobyte-b0dbb375-83c7-4368-951d-dc766f881374" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4b882d4e-3598-4d8c-a345-06a15dcee07b tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-b0dbb375-83c7-4368-951d-dc766f881374" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9511cd17-ab07-4ba7-8d17-4ee998f2b2bc]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4b882d4e-3598-4d8c-a345-06a15dcee07b tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:40 devstack sudo[84516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374 Feb 27 12:28:40 devstack sudo[84516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Flow 'volume_create_manager' (5e6b461c-567f-4168-933b-68ebff4e612f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e7f021-b1d9-4fcb-bd35-374871115fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e7f021-b1d9-4fcb-bd35-374871115fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1739803984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c416d459-b384-410c-9849-436f02b8cfd7,host='devstack@QuobyteHD#QuobyteHD',id=8cac7bf6-5a48-4189-bddf-4eb6291bd989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea77d8fa67be4be2bf0d086bdad64352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:28:40Z,use_quota=True,user_id='1e5d016f230c4f34bb125dff06869683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18e2e814-9545-4c91-bc81-963bc723d8ed),volume_type_id=18e2e814-9545-4c91-bc81-963bc723d8ed)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bce87f0-a60f-4ee2-962e-7ec98feea597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bce87f0-a60f-4ee2-962e-7ec98feea597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a3c3e9-59b8-4a5f-8646-239a2d188086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a3c3e9-59b8-4a5f-8646-239a2d188086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cac7bf6-5a48-4189-bddf-4eb6291bd989', 'volume_name': 'volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8def1755-151c-412b-bbd5-6f9fe5129243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8def1755-151c-412b-bbd5-6f9fe5129243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafda9d3-151d-4583-917f-f55e92232fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:40 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Volume 8cac7bf6-5a48-4189-bddf-4eb6291bd989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989', 'volume_size': 1} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c416d459-b384-410c-9849-436f02b8cfd7,created_at=2026-02-27T11:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1739803984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c416d459-b384-410c-9849-436f02b8cfd7,host='devstack@QuobyteHD#QuobyteHD',id=8cac7bf6-5a48-4189-bddf-4eb6291bd989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea77d8fa67be4be2bf0d086bdad64352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:28:40Z,use_quota=True,user_id='1e5d016f230c4f34bb125dff06869683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18e2e814-9545-4c91-bc81-963bc723d8ed),volume_type_id=18e2e814-9545-4c91-bc81-963bc723d8ed)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Creating volume 8cac7bf6-5a48-4189-bddf-4eb6291bd989 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:28:40 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:40 devstack sudo[84518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989 1073741824 Feb 27 12:28:40 devstack sudo[84518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-14167f51-1e34-4b91-afc6-b31e19fc1317 tempest-DeleteServersTestJSON-654972149 None] Acquiring lock "cinder-821120da-dc47-43dd-accf-e7ac291beabb-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-14167f51-1e34-4b91-afc6-b31e19fc1317 tempest-DeleteServersTestJSON-654972149 None] Lock "cinder-821120da-dc47-43dd-accf-e7ac291beabb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-14167f51-1e34-4b91-afc6-b31e19fc1317 tempest-DeleteServersTestJSON-654972149 None] Acquiring lock "cinder-quobyte-821120da-dc47-43dd-accf-e7ac291beabb" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-14167f51-1e34-4b91-afc6-b31e19fc1317 tempest-DeleteServersTestJSON-654972149 None] Lock "cinder-quobyte-821120da-dc47-43dd-accf-e7ac291beabb" acquired by "delete_volume" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac8dcd8-3d39-4fd3-b4b5-8e37bd319f28]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-14167f51-1e34-4b91-afc6-b31e19fc1317 tempest-DeleteServersTestJSON-654972149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-821120da-dc47-43dd-accf-e7ac291beabb {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:40 devstack sudo[84521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-821120da-dc47-43dd-accf-e7ac291beabb Feb 27 12:28:40 devstack sudo[84521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:40 devstack sudo[84516]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4b882d4e-3598-4d8c-a345-06a15dcee07b tempest-GroupSnapshotsTest-1932635372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374" returned: 0 in 0.586s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4b882d4e-3598-4d8c-a345-06a15dcee07b tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:40 devstack sudo[84527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374 Feb 27 12:28:40 devstack sudo[84527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:40 devstack sudo[84518]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989 1073741824" returned: 0 in 0.503s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:40 devstack sudo[84533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989 Feb 27 12:28:40 devstack sudo[84533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:41 devstack sudo[84521]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-14167f51-1e34-4b91-afc6-b31e19fc1317 tempest-DeleteServersTestJSON-654972149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-821120da-dc47-43dd-accf-e7ac291beabb" returned: 0 in 0.511s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-14167f51-1e34-4b91-afc6-b31e19fc1317 tempest-DeleteServersTestJSON-654972149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-821120da-dc47-43dd-accf-e7ac291beabb {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:41 devstack sudo[84539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-821120da-dc47-43dd-accf-e7ac291beabb Feb 27 12:28:41 devstack sudo[84539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:41 devstack sudo[84527]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4b882d4e-3598-4d8c-a345-06a15dcee07b tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b0dbb375-83c7-4368-951d-dc766f881374" returned: 0 in 0.452s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4b882d4e-3598-4d8c-a345-06a15dcee07b tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-b0dbb375-83c7-4368-951d-dc766f881374" released by "delete_volume" :: held 1.079s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-4b882d4e-3598-4d8c-a345-06a15dcee07b tempest-GroupSnapshotsTest-1932635372 None] Created reservations ['e2cd2895-c5eb-4bbd-a214-6f984f24f07e'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:28:41 devstack cinder-volume[83077]: WARNING cinder.db.sqlalchemy.api [None req-4b882d4e-3598-4d8c-a345-06a15dcee07b tempest-GroupSnapshotsTest-1932635372 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-597743432'] Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-4b882d4e-3598-4d8c-a345-06a15dcee07b tempest-GroupSnapshotsTest-1932635372 None] Created reservations ['f141a33b-6cef-4b99-97ef-f8251e76b688', 'd3cab1cc-ea65-4d10-9580-45cdad9b5746', 'ffcdc540-71fc-4274-9593-6129e4cd19c7', 'f6136f1d-165e-4df1-a8f7-417fa456751c'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-4b882d4e-3598-4d8c-a345-06a15dcee07b tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-4b882d4e-3598-4d8c-a345-06a15dcee07b tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-4b882d4e-3598-4d8c-a345-06a15dcee07b tempest-GroupSnapshotsTest-1932635372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-4b882d4e-3598-4d8c-a345-06a15dcee07b tempest-GroupSnapshotsTest-1932635372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-4b882d4e-3598-4d8c-a345-06a15dcee07b tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4b882d4e-3598-4d8c-a345-06a15dcee07b tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:41 devstack sudo[84542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:28:41 devstack sudo[84542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:41 devstack sudo[84533]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989" returned: 0 in 0.525s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafda9d3-151d-4583-917f-f55e92232fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6fcb05a-4bf9-4ae2-8db6-2175081ccc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:41 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Volume volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989 (8cac7bf6-5a48-4189-bddf-4eb6291bd989): created successfully Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6fcb05a-4bf9-4ae2-8db6-2175081ccc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Flow 'volume_create_manager' (5e6b461c-567f-4168-933b-68ebff4e612f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:28:41 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-8b84dfcd-0b3d-45f1-9188-b7167e78ac18 tempest-GroupSnapshotsV319Test-358563587 None] Created volume successfully. Feb 27 12:28:41 devstack sudo[84539]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-14167f51-1e34-4b91-afc6-b31e19fc1317 tempest-DeleteServersTestJSON-654972149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-821120da-dc47-43dd-accf-e7ac291beabb" returned: 0 in 0.458s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-14167f51-1e34-4b91-afc6-b31e19fc1317 tempest-DeleteServersTestJSON-654972149 None] Lock "cinder-quobyte-821120da-dc47-43dd-accf-e7ac291beabb" released by "delete_volume" :: held 0.989s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-14167f51-1e34-4b91-afc6-b31e19fc1317 tempest-DeleteServersTestJSON-654972149 None] Created reservations ['752757fb-4ace-4428-b90b-4167b7c39cd8', '327310ac-4f87-4c74-9358-561b0d285dc5', '1632be61-cf0c-4e86-a503-cabd273ddbb7', 'cd17af7f-6d3b-4cd5-9fd3-f6465af0f9cf'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-14167f51-1e34-4b91-afc6-b31e19fc1317 tempest-DeleteServersTestJSON-654972149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-14167f51-1e34-4b91-afc6-b31e19fc1317 tempest-DeleteServersTestJSON-654972149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-14167f51-1e34-4b91-afc6-b31e19fc1317 tempest-DeleteServersTestJSON-654972149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-14167f51-1e34-4b91-afc6-b31e19fc1317 tempest-DeleteServersTestJSON-654972149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-14167f51-1e34-4b91-afc6-b31e19fc1317 tempest-DeleteServersTestJSON-654972149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-14167f51-1e34-4b91-afc6-b31e19fc1317 tempest-DeleteServersTestJSON-654972149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:41 devstack sudo[84546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:28:41 devstack sudo[84546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:41 devstack sudo[84542]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4b882d4e-3598-4d8c-a345-06a15dcee07b tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.425s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:41 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-4b882d4e-3598-4d8c-a345-06a15dcee07b tempest-GroupSnapshotsTest-1932635372 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:28:41 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-4b882d4e-3598-4d8c-a345-06a15dcee07b tempest-GroupSnapshotsTest-1932635372 None] Delete group completed successfully. Feb 27 12:28:42 devstack sudo[84546]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-14167f51-1e34-4b91-afc6-b31e19fc1317 tempest-DeleteServersTestJSON-654972149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.393s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:42 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-14167f51-1e34-4b91-afc6-b31e19fc1317 tempest-DeleteServersTestJSON-654972149 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:28:42 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-14167f51-1e34-4b91-afc6-b31e19fc1317 tempest-DeleteServersTestJSON-654972149 None] Deleted volume successfully. Feb 27 12:28:42 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-14167f51-1e34-4b91-afc6-b31e19fc1317 tempest-DeleteServersTestJSON-654972149 None] Lock "cinder-821120da-dc47-43dd-accf-e7ac291beabb-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:28:42 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-256b3af5-3a8f-4898-a191-1a1942eb6564 tempest-GroupSnapshotsV319Test-358563587 None] GroupSnapshot eb9fdc88-c96e-43a8-879b-6b0a1f5d6047: creating. Feb 27 12:28:42 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-256b3af5-3a8f-4898-a191-1a1942eb6564 tempest-GroupSnapshotsV319Test-358563587 None] Group snapshot eb9fdc88-c96e-43a8-879b-6b0a1f5d6047: creating. {{(pid=83077) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 12:28:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-256b3af5-3a8f-4898-a191-1a1942eb6564 tempest-GroupSnapshotsV319Test-358563587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-256b3af5-3a8f-4898-a191-1a1942eb6564 tempest-GroupSnapshotsV319Test-358563587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:42 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-256b3af5-3a8f-4898-a191-1a1942eb6564 tempest-GroupSnapshotsV319Test-358563587 None] Creating offline snapshot 559ca367-c88a-4a39-9459-120c0b04e4f1 of volume 8cac7bf6-5a48-4189-bddf-4eb6291bd989 {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:28:42 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22ec734-7de6-4e93-91b7-22353a07d6fd]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:28:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-256b3af5-3a8f-4898-a191-1a1942eb6564 tempest-GroupSnapshotsV319Test-358563587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:42 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-1e91ae8d-915c-459b-b02c-a7d99b0fb501 tempest-GroupSnapshotsTest-1932635372 None] Group tempest-GroupSnapshotsTest-Group-1686557565: creating Feb 27 12:28:42 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-1e91ae8d-915c-459b-b02c-a7d99b0fb501 tempest-GroupSnapshotsTest-1932635372 None] Group tempest-GroupSnapshotsTest-Group-1686557565: created successfully Feb 27 12:28:42 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-1e91ae8d-915c-459b-b02c-a7d99b0fb501 tempest-GroupSnapshotsTest-1932635372 None] Create group completed successfully. Feb 27 12:28:42 devstack sudo[84550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989 Feb 27 12:28:42 devstack sudo[84550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:43 devstack sudo[84550]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-256b3af5-3a8f-4898-a191-1a1942eb6564 tempest-GroupSnapshotsV319Test-358563587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989" returned: 0 in 0.503s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-256b3af5-3a8f-4898-a191-1a1942eb6564 tempest-GroupSnapshotsV319Test-358563587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989.559ca367-c88a-4a39-9459-120c0b04e4f1 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:43 devstack sudo[84555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989.559ca367-c88a-4a39-9459-120c0b04e4f1 1G Feb 27 12:28:43 devstack sudo[84555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:43 devstack sudo[84555]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-256b3af5-3a8f-4898-a191-1a1942eb6564 tempest-GroupSnapshotsV319Test-358563587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989.559ca367-c88a-4a39-9459-120c0b04e4f1 1G" returned: 0 in 0.507s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-256b3af5-3a8f-4898-a191-1a1942eb6564 tempest-GroupSnapshotsV319Test-358563587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989.559ca367-c88a-4a39-9459-120c0b04e4f1 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:43 devstack sudo[84560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989.559ca367-c88a-4a39-9459-120c0b04e4f1 Feb 27 12:28:43 devstack sudo[84560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:43 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:28:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Flow 'volume_create_manager' (8c4bc44c-6d71-459e-88dd-44b3aa845381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:28:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9ef885-9ed5-4cb4-8902-fb5c8ff6576d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9ef885-9ed5-4cb4-8902-fb5c8ff6576d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2128652308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=deef74d9-0ce8-4e20-b531-c2226d48838f,host='devstack@QuobyteHD#QuobyteHD',id=fa10aa1e-7753-494e-b3bd-ea735e6eee06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56278194745946eea7d8b1ee011abce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:28:44Z,use_quota=True,user_id='31ea13b75a134b1190251920fb03c0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2b2b0b8-2bef-4ed6-9cd0-94afeb49bcd7),volume_type_id=d2b2b0b8-2bef-4ed6-9cd0-94afeb49bcd7)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f471e3f-1787-4134-965b-c3688b2ad5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f471e3f-1787-4134-965b-c3688b2ad5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be96a75-7c7e-46e5-a08f-86887954440e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be96a75-7c7e-46e5-a08f-86887954440e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa10aa1e-7753-494e-b3bd-ea735e6eee06', 'volume_name': 'volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d752008e-5d9d-4990-ba16-008f79fd627d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d752008e-5d9d-4990-ba16-008f79fd627d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d811083-44ee-4e41-8b1d-0cac860aee01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:44 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Volume fa10aa1e-7753-494e-b3bd-ea735e6eee06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06', 'volume_size': 1} Feb 27 12:28:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:44 devstack sudo[84560]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-256b3af5-3a8f-4898-a191-1a1942eb6564 tempest-GroupSnapshotsV319Test-358563587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989.559ca367-c88a-4a39-9459-120c0b04e4f1" returned: 0 in 0.538s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:44 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-256b3af5-3a8f-4898-a191-1a1942eb6564 tempest-GroupSnapshotsV319Test-358563587 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989.559ca367-c88a-4a39-9459-120c0b04e4f1 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 12:28:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-256b3af5-3a8f-4898-a191-1a1942eb6564 tempest-GroupSnapshotsV319Test-358563587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989.559ca367-c88a-4a39-9459-120c0b04e4f1 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:44 devstack sudo[84566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989.559ca367-c88a-4a39-9459-120c0b04e4f1 Feb 27 12:28:44 devstack sudo[84566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:44 devstack sudo[84566]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-256b3af5-3a8f-4898-a191-1a1942eb6564 tempest-GroupSnapshotsV319Test-358563587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989.559ca367-c88a-4a39-9459-120c0b04e4f1" returned: 0 in 0.455s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-256b3af5-3a8f-4898-a191-1a1942eb6564 tempest-GroupSnapshotsV319Test-358563587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:44 devstack sudo[84569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989.info Feb 27 12:28:44 devstack sudo[84569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:45 devstack sudo[84569]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-256b3af5-3a8f-4898-a191-1a1942eb6564 tempest-GroupSnapshotsV319Test-358563587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989.info" returned: 0 in 0.514s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:45 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-256b3af5-3a8f-4898-a191-1a1942eb6564 tempest-GroupSnapshotsV319Test-358563587 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 12:28:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-256b3af5-3a8f-4898-a191-1a1942eb6564 tempest-GroupSnapshotsV319Test-358563587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:45 devstack sudo[84572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989.info Feb 27 12:28:45 devstack sudo[84572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:45 devstack sudo[84572]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-256b3af5-3a8f-4898-a191-1a1942eb6564 tempest-GroupSnapshotsV319Test-358563587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989.info" returned: 0 in 0.486s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-256b3af5-3a8f-4898-a191-1a1942eb6564 tempest-GroupSnapshotsV319Test-358563587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.059s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.699s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:45 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=deef74d9-0ce8-4e20-b531-c2226d48838f,created_at=2026-02-27T11:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2128652308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=deef74d9-0ce8-4e20-b531-c2226d48838f,host='devstack@QuobyteHD#QuobyteHD',id=fa10aa1e-7753-494e-b3bd-ea735e6eee06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56278194745946eea7d8b1ee011abce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:28:44Z,use_quota=True,user_id='31ea13b75a134b1190251920fb03c0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2b2b0b8-2bef-4ed6-9cd0-94afeb49bcd7),volume_type_id=d2b2b0b8-2bef-4ed6-9cd0-94afeb49bcd7)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:28:45 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Creating volume fa10aa1e-7753-494e-b3bd-ea735e6eee06 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:28:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:45 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:28:45 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:28:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:45 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:28:45 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:28:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:45 devstack sudo[84577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06 1073741824 Feb 27 12:28:45 devstack sudo[84577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:45 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-256b3af5-3a8f-4898-a191-1a1942eb6564 tempest-GroupSnapshotsV319Test-358563587 None] group_snapshot eb9fdc88-c96e-43a8-879b-6b0a1f5d6047: created successfully Feb 27 12:28:46 devstack sudo[84577]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06 1073741824" returned: 0 in 0.586s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:46 devstack sudo[84582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06 Feb 27 12:28:46 devstack sudo[84582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:46 devstack sudo[84582]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06" returned: 0 in 0.404s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:46 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:28:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d811083-44ee-4e41-8b1d-0cac860aee01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d021ad86-79a2-42c0-9a43-7cc04cde5935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:46 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Volume volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06 (fa10aa1e-7753-494e-b3bd-ea735e6eee06): created successfully Feb 27 12:28:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d021ad86-79a2-42c0-9a43-7cc04cde5935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Flow 'volume_create_manager' (8c4bc44c-6d71-459e-88dd-44b3aa845381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:28:46 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-874f099e-f2ec-4450-9cff-6603d3d72bd2 tempest-GroupSnapshotsTest-1932635372 None] Created volume successfully. Feb 27 12:28:47 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-d5fb117f-b775-4d41-8349-89d7eea2648e tempest-GroupSnapshotsV319Test-358563587 None] group_snapshot eb9fdc88-c96e-43a8-879b-6b0a1f5d6047: deleting Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d5fb117f-b775-4d41-8349-89d7eea2648e tempest-GroupSnapshotsV319Test-358563587 None] group_snapshot eb9fdc88-c96e-43a8-879b-6b0a1f5d6047: deleting {{(pid=83077) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d5fb117f-b775-4d41-8349-89d7eea2648e tempest-GroupSnapshotsV319Test-358563587 None] Acquiring lock "cinder-quobyte-8cac7bf6-5a48-4189-bddf-4eb6291bd989" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d5fb117f-b775-4d41-8349-89d7eea2648e tempest-GroupSnapshotsV319Test-358563587 None] Lock "cinder-quobyte-8cac7bf6-5a48-4189-bddf-4eb6291bd989" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d5fb117f-b775-4d41-8349-89d7eea2648e tempest-GroupSnapshotsV319Test-358563587 None] Acquiring lock "cinder-quobyte-559ca367-c88a-4a39-9459-120c0b04e4f1" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d5fb117f-b775-4d41-8349-89d7eea2648e tempest-GroupSnapshotsV319Test-358563587 None] Lock "cinder-quobyte-559ca367-c88a-4a39-9459-120c0b04e4f1" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-d5fb117f-b775-4d41-8349-89d7eea2648e tempest-GroupSnapshotsV319Test-358563587 None] Deleting offline snapshot 559ca367-c88a-4a39-9459-120c0b04e4f1 of volume 8cac7bf6-5a48-4189-bddf-4eb6291bd989 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-d5fb117f-b775-4d41-8349-89d7eea2648e tempest-GroupSnapshotsV319Test-358563587 None] snapshot_file for this snap is: volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989.559ca367-c88a-4a39-9459-120c0b04e4f1 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25c7c15-5549-4277-b592-b95f8ad89f20]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d5fb117f-b775-4d41-8349-89d7eea2648e tempest-GroupSnapshotsV319Test-358563587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989.559ca367-c88a-4a39-9459-120c0b04e4f1 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:47 devstack sudo[84585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989.559ca367-c88a-4a39-9459-120c0b04e4f1 Feb 27 12:28:47 devstack sudo[84585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Flow 'volume_create_manager' (a1c8a34f-d3cf-4d42-b34a-d02a9760877f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62ed303-1872-43c5-abb4-f59f49509ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62ed303-1872-43c5-abb4-f59f49509ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1338448968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=deef74d9-0ce8-4e20-b531-c2226d48838f,host='devstack@QuobyteHD#QuobyteHD',id=2390f21c-93fa-466e-9588-da2bf27761bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56278194745946eea7d8b1ee011abce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:28:48Z,use_quota=True,user_id='31ea13b75a134b1190251920fb03c0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2b2b0b8-2bef-4ed6-9cd0-94afeb49bcd7),volume_type_id=d2b2b0b8-2bef-4ed6-9cd0-94afeb49bcd7)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098a7a67-7dbb-4241-9c5f-217747d5e7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098a7a67-7dbb-4241-9c5f-217747d5e7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e160791-d765-462d-a05b-1a7a7af7edfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e160791-d765-462d-a05b-1a7a7af7edfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2390f21c-93fa-466e-9588-da2bf27761bc', 'volume_name': 'volume-2390f21c-93fa-466e-9588-da2bf27761bc', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18a74b2-fcac-4c79-8264-86e595da4ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18a74b2-fcac-4c79-8264-86e595da4ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a2f67d7-6068-4cbd-bdc8-82deb73cbb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:47 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Volume 2390f21c-93fa-466e-9588-da2bf27761bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2390f21c-93fa-466e-9588-da2bf27761bc', 'volume_size': 1} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=deef74d9-0ce8-4e20-b531-c2226d48838f,created_at=2026-02-27T11:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1338448968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=deef74d9-0ce8-4e20-b531-c2226d48838f,host='devstack@QuobyteHD#QuobyteHD',id=2390f21c-93fa-466e-9588-da2bf27761bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56278194745946eea7d8b1ee011abce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:28:48Z,use_quota=True,user_id='31ea13b75a134b1190251920fb03c0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2b2b0b8-2bef-4ed6-9cd0-94afeb49bcd7),volume_type_id=d2b2b0b8-2bef-4ed6-9cd0-94afeb49bcd7)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Creating volume 2390f21c-93fa-466e-9588-da2bf27761bc {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:28:47 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:47 devstack sudo[84588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc 1073741824 Feb 27 12:28:47 devstack sudo[84588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:47 devstack sudo[84585]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d5fb117f-b775-4d41-8349-89d7eea2648e tempest-GroupSnapshotsV319Test-358563587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989.559ca367-c88a-4a39-9459-120c0b04e4f1" returned: 0 in 0.684s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:47 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-d5fb117f-b775-4d41-8349-89d7eea2648e tempest-GroupSnapshotsV319Test-358563587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:28:48 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[4488355c-fa5e-4f64-93e0-1eb119913526]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:28:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d5fb117f-b775-4d41-8349-89d7eea2648e tempest-GroupSnapshotsV319Test-358563587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:48 devstack sudo[84593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989 Feb 27 12:28:48 devstack sudo[84593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:48 devstack sudo[84588]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc 1073741824" returned: 0 in 0.763s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:48 devstack sudo[84593]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d5fb117f-b775-4d41-8349-89d7eea2648e tempest-GroupSnapshotsV319Test-358563587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989" returned: 0 in 0.549s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d5fb117f-b775-4d41-8349-89d7eea2648e tempest-GroupSnapshotsV319Test-358563587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989.559ca367-c88a-4a39-9459-120c0b04e4f1 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:48 devstack sudo[84601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989.559ca367-c88a-4a39-9459-120c0b04e4f1 Feb 27 12:28:48 devstack sudo[84601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:48 devstack sudo[84602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc Feb 27 12:28:48 devstack sudo[84602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:49 devstack sudo[84602]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc" returned: 0 in 0.528s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:49 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:28:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:49 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a2f67d7-6068-4cbd-bdc8-82deb73cbb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2390f21c-93fa-466e-9588-da2bf27761bc', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:49 devstack sudo[84601]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:49 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ea093ad-42be-4c81-961f-63e523133de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:28:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d5fb117f-b775-4d41-8349-89d7eea2648e tempest-GroupSnapshotsV319Test-358563587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989.559ca367-c88a-4a39-9459-120c0b04e4f1" returned: 0 in 0.575s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d5fb117f-b775-4d41-8349-89d7eea2648e tempest-GroupSnapshotsV319Test-358563587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989.559ca367-c88a-4a39-9459-120c0b04e4f1 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:49 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Volume volume-2390f21c-93fa-466e-9588-da2bf27761bc (2390f21c-93fa-466e-9588-da2bf27761bc): created successfully Feb 27 12:28:49 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ea093ad-42be-4c81-961f-63e523133de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:28:49 devstack sudo[84610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989.559ca367-c88a-4a39-9459-120c0b04e4f1 Feb 27 12:28:49 devstack sudo[84610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:49 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Flow 'volume_create_manager' (a1c8a34f-d3cf-4d42-b34a-d02a9760877f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:28:49 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-4cefa2df-cec1-4857-a8ed-07a76a1fce3c tempest-GroupSnapshotsTest-1932635372 None] Created volume successfully. Feb 27 12:28:49 devstack sudo[84610]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d5fb117f-b775-4d41-8349-89d7eea2648e tempest-GroupSnapshotsV319Test-358563587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989.559ca367-c88a-4a39-9459-120c0b04e4f1" returned: 0 in 0.465s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:49 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d5fb117f-b775-4d41-8349-89d7eea2648e tempest-GroupSnapshotsV319Test-358563587 None] Lock "cinder-quobyte-559ca367-c88a-4a39-9459-120c0b04e4f1" released by "_delete_snapshot" :: held 2.346s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:28:49 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d5fb117f-b775-4d41-8349-89d7eea2648e tempest-GroupSnapshotsV319Test-358563587 None] Lock "cinder-quobyte-8cac7bf6-5a48-4189-bddf-4eb6291bd989" released by "delete_snapshot" :: held 2.376s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:28:49 devstack cinder-volume[83077]: WARNING cinder.quota [None req-d5fb117f-b775-4d41-8349-89d7eea2648e tempest-GroupSnapshotsV319Test-358563587 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1483777591 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1483777591, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:28:49 devstack cinder-volume[83077]: WARNING cinder.quota [None req-d5fb117f-b775-4d41-8349-89d7eea2648e tempest-GroupSnapshotsV319Test-358563587 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1483777591 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1483777591, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:28:49 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-d5fb117f-b775-4d41-8349-89d7eea2648e tempest-GroupSnapshotsV319Test-358563587 None] Created reservations ['7d5b919f-3140-4d14-aeae-ea33cb2ce0d1', '2a3edd71-7666-4af9-8553-a3dec82dd60c', '68ed9406-5d07-4298-8c7a-687d6d7f900d', 'bbcd6148-76a6-42b9-9cc1-a120ea1166f2'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:28:49 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-d5fb117f-b775-4d41-8349-89d7eea2648e tempest-GroupSnapshotsV319Test-358563587 None] group_snapshot eb9fdc88-c96e-43a8-879b-6b0a1f5d6047: deleted successfully Feb 27 12:28:50 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-7bf8668b-9543-4afe-9ef0-ef2516dec900 tempest-GroupSnapshotsTest-1932635372 None] Update group completed successfully. Feb 27 12:28:50 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-791b92f7-41ac-4f20-b60e-717b000463ff tempest-GroupSnapshotsV319Test-358563587 None] Acquiring lock "cinder-quobyte-8cac7bf6-5a48-4189-bddf-4eb6291bd989" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:28:50 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-791b92f7-41ac-4f20-b60e-717b000463ff tempest-GroupSnapshotsV319Test-358563587 None] Lock "cinder-quobyte-8cac7bf6-5a48-4189-bddf-4eb6291bd989" acquired by "delete_volume" :: waited 0.014s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:28:50 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[18838761-4097-41c6-a2ef-441d72757f6d]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:28:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-791b92f7-41ac-4f20-b60e-717b000463ff tempest-GroupSnapshotsV319Test-358563587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:50 devstack sudo[84614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989 Feb 27 12:28:50 devstack sudo[84614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:51 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-aa70a167-110b-4702-a28e-bdeb284aba9d tempest-GroupSnapshotsTest-1932635372 None] Update group completed successfully. Feb 27 12:28:51 devstack sudo[84614]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-791b92f7-41ac-4f20-b60e-717b000463ff tempest-GroupSnapshotsV319Test-358563587 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989" returned: 0 in 0.627s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-791b92f7-41ac-4f20-b60e-717b000463ff tempest-GroupSnapshotsV319Test-358563587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:51 devstack sudo[84620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989 Feb 27 12:28:51 devstack sudo[84620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:51 devstack sudo[84620]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-791b92f7-41ac-4f20-b60e-717b000463ff tempest-GroupSnapshotsV319Test-358563587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8cac7bf6-5a48-4189-bddf-4eb6291bd989" returned: 0 in 0.420s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:51 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-791b92f7-41ac-4f20-b60e-717b000463ff tempest-GroupSnapshotsV319Test-358563587 None] Lock "cinder-quobyte-8cac7bf6-5a48-4189-bddf-4eb6291bd989" released by "delete_volume" :: held 1.099s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:28:51 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-791b92f7-41ac-4f20-b60e-717b000463ff tempest-GroupSnapshotsV319Test-358563587 None] Created reservations ['8fb3b9da-a0ef-4db4-b62c-b8680bb870b8'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:28:51 devstack cinder-volume[83077]: WARNING cinder.quota [None req-791b92f7-41ac-4f20-b60e-717b000463ff tempest-GroupSnapshotsV319Test-358563587 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1483777591 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1483777591, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:28:51 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-791b92f7-41ac-4f20-b60e-717b000463ff tempest-GroupSnapshotsV319Test-358563587 None] Created reservations ['94706048-3c7d-499b-aeab-3340ff1a3d69', 'a57ab3ca-1ce6-45d9-86fd-e5996018c5a5', 'e0064eca-fd62-447d-b808-2befa4d3e06c', 'f63bacf5-3ce2-4086-99d3-3f1c41acc5fe'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:28:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-791b92f7-41ac-4f20-b60e-717b000463ff tempest-GroupSnapshotsV319Test-358563587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-791b92f7-41ac-4f20-b60e-717b000463ff tempest-GroupSnapshotsV319Test-358563587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:51 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-791b92f7-41ac-4f20-b60e-717b000463ff tempest-GroupSnapshotsV319Test-358563587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:28:51 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-791b92f7-41ac-4f20-b60e-717b000463ff tempest-GroupSnapshotsV319Test-358563587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:28:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-791b92f7-41ac-4f20-b60e-717b000463ff tempest-GroupSnapshotsV319Test-358563587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-791b92f7-41ac-4f20-b60e-717b000463ff tempest-GroupSnapshotsV319Test-358563587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:51 devstack sudo[84623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:28:51 devstack sudo[84623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:52 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-19cd7eb3-0915-46b0-b06c-7b30f6910e19 tempest-GroupSnapshotsTest-1932635372 None] Update group completed successfully. Feb 27 12:28:52 devstack sudo[84623]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-791b92f7-41ac-4f20-b60e-717b000463ff tempest-GroupSnapshotsV319Test-358563587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.573s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:52 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-791b92f7-41ac-4f20-b60e-717b000463ff tempest-GroupSnapshotsV319Test-358563587 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:28:52 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-791b92f7-41ac-4f20-b60e-717b000463ff tempest-GroupSnapshotsV319Test-358563587 None] Delete group completed successfully. Feb 27 12:28:53 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-ce91fa2b-07d6-442a-9057-39d8a12b55fb tempest-GroupSnapshotsTest-1932635372 None] Update group completed successfully. Feb 27 12:28:54 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] GroupSnapshot 4d02aa34-a8da-485c-bdd1-7f4d460cab2f: creating. Feb 27 12:28:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] Group snapshot 4d02aa34-a8da-485c-bdd1-7f4d460cab2f: creating. {{(pid=83077) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 12:28:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:55 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] Creating offline snapshot 03160eef-fdf4-4e8c-b86c-6bd8135a5bd3 of volume fa10aa1e-7753-494e-b3bd-ea735e6eee06 {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:28:55 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a3860f-f799-4e4d-bced-5290093d520a]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:28:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:55 devstack sudo[84627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06 Feb 27 12:28:55 devstack sudo[84627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:55 devstack sudo[84627]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06" returned: 0 in 0.690s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06.03160eef-fdf4-4e8c-b86c-6bd8135a5bd3 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:55 devstack sudo[84632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06.03160eef-fdf4-4e8c-b86c-6bd8135a5bd3 1G Feb 27 12:28:55 devstack sudo[84632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:56 devstack sudo[84632]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06.03160eef-fdf4-4e8c-b86c-6bd8135a5bd3 1G" returned: 0 in 0.624s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06.03160eef-fdf4-4e8c-b86c-6bd8135a5bd3 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:56 devstack sudo[84639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06.03160eef-fdf4-4e8c-b86c-6bd8135a5bd3 Feb 27 12:28:56 devstack sudo[84639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:57 devstack sudo[84639]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06.03160eef-fdf4-4e8c-b86c-6bd8135a5bd3" returned: 0 in 0.774s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:57 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06.03160eef-fdf4-4e8c-b86c-6bd8135a5bd3 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 12:28:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06.03160eef-fdf4-4e8c-b86c-6bd8135a5bd3 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:57 devstack sudo[84647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06.03160eef-fdf4-4e8c-b86c-6bd8135a5bd3 Feb 27 12:28:57 devstack sudo[84647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:57 devstack sudo[84647]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06.03160eef-fdf4-4e8c-b86c-6bd8135a5bd3" returned: 0 in 0.510s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:57 devstack sudo[84652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06.info Feb 27 12:28:57 devstack sudo[84652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:58 devstack sudo[84652]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06.info" returned: 0 in 0.525s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:58 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 12:28:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:58 devstack sudo[84655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06.info Feb 27 12:28:58 devstack sudo[84655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:58 devstack cinder-volume[83077]: DEBUG oslo_service.periodic_task [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83077) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 12:28:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:28:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:28:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:58 devstack sudo[84657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:28:58 devstack sudo[84657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:58 devstack sudo[84655]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06.info" returned: 0 in 0.546s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.739s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] Creating offline snapshot d86198d0-e62b-47c2-be7b-5f0827ea35a2 of volume 2390f21c-93fa-466e-9588-da2bf27761bc {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:28:58 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d110da-599a-449b-b696-ff3df786a18f]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:28:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:58 devstack sudo[84660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc Feb 27 12:28:58 devstack sudo[84660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:58 devstack sudo[84657]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.467s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:58 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:28:59 devstack sudo[84660]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc" returned: 0 in 0.583s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc.d86198d0-e62b-47c2-be7b-5f0827ea35a2 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:59 devstack sudo[84666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc.d86198d0-e62b-47c2-be7b-5f0827ea35a2 1G Feb 27 12:28:59 devstack sudo[84666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:59 devstack sudo[84666]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc.d86198d0-e62b-47c2-be7b-5f0827ea35a2 1G" returned: 0 in 0.623s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2390f21c-93fa-466e-9588-da2bf27761bc -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc.d86198d0-e62b-47c2-be7b-5f0827ea35a2 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:59 devstack sudo[84671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2390f21c-93fa-466e-9588-da2bf27761bc -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc.d86198d0-e62b-47c2-be7b-5f0827ea35a2 Feb 27 12:28:59 devstack sudo[84671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:00 devstack sudo[84671]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2390f21c-93fa-466e-9588-da2bf27761bc -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc.d86198d0-e62b-47c2-be7b-5f0827ea35a2" returned: 0 in 0.581s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:00 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc.d86198d0-e62b-47c2-be7b-5f0827ea35a2 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 12:29:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc.d86198d0-e62b-47c2-be7b-5f0827ea35a2 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:00 devstack sudo[84676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc.d86198d0-e62b-47c2-be7b-5f0827ea35a2 Feb 27 12:29:00 devstack sudo[84676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:01 devstack sudo[84676]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc.d86198d0-e62b-47c2-be7b-5f0827ea35a2" returned: 0 in 0.486s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:01 devstack sudo[84680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc.info Feb 27 12:29:01 devstack sudo[84680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:01 devstack sudo[84680]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc.info" returned: 0 in 0.652s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:01 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 12:29:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:01 devstack sudo[84683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc.info Feb 27 12:29:01 devstack sudo[84683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:02 devstack sudo[84683]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc.info" returned: 0 in 0.557s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.540s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:02 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-67419222-0791-490e-805b-212a689ad639 tempest-GroupSnapshotsTest-1932635372 None] group_snapshot 4d02aa34-a8da-485c-bdd1-7f4d460cab2f: created successfully Feb 27 12:29:03 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] group_snapshot 4d02aa34-a8da-485c-bdd1-7f4d460cab2f: deleting Feb 27 12:29:03 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] group_snapshot 4d02aa34-a8da-485c-bdd1-7f4d460cab2f: deleting {{(pid=83077) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 12:29:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "cinder-quobyte-fa10aa1e-7753-494e-b3bd-ea735e6eee06" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:29:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-fa10aa1e-7753-494e-b3bd-ea735e6eee06" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:29:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "cinder-quobyte-03160eef-fdf4-4e8c-b86c-6bd8135a5bd3" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:29:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-03160eef-fdf4-4e8c-b86c-6bd8135a5bd3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:29:03 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Deleting offline snapshot 03160eef-fdf4-4e8c-b86c-6bd8135a5bd3 of volume fa10aa1e-7753-494e-b3bd-ea735e6eee06 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:29:03 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] snapshot_file for this snap is: volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06.03160eef-fdf4-4e8c-b86c-6bd8135a5bd3 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:29:03 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8caa89-d706-46df-845d-5b414717799b]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:29:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06.03160eef-fdf4-4e8c-b86c-6bd8135a5bd3 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:03 devstack sudo[84702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06.03160eef-fdf4-4e8c-b86c-6bd8135a5bd3 Feb 27 12:29:03 devstack sudo[84702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:04 devstack sudo[84702]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06.03160eef-fdf4-4e8c-b86c-6bd8135a5bd3" returned: 0 in 0.577s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:29:04 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f505c4-2f62-4d4b-b882-6e4236fd07b8]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:29:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:04 devstack sudo[84707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06 Feb 27 12:29:04 devstack sudo[84707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:04 devstack sudo[84707]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06" returned: 0 in 0.618s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06.03160eef-fdf4-4e8c-b86c-6bd8135a5bd3 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:04 devstack sudo[84712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06.03160eef-fdf4-4e8c-b86c-6bd8135a5bd3 Feb 27 12:29:04 devstack sudo[84712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:05 devstack sudo[84712]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06.03160eef-fdf4-4e8c-b86c-6bd8135a5bd3" returned: 0 in 0.607s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06.03160eef-fdf4-4e8c-b86c-6bd8135a5bd3 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:05 devstack sudo[84730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06.03160eef-fdf4-4e8c-b86c-6bd8135a5bd3 Feb 27 12:29:05 devstack sudo[84730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:05 devstack sudo[84730]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06.03160eef-fdf4-4e8c-b86c-6bd8135a5bd3" returned: 0 in 0.478s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:05 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-03160eef-fdf4-4e8c-b86c-6bd8135a5bd3" released by "_delete_snapshot" :: held 2.359s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:29:05 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-fa10aa1e-7753-494e-b3bd-ea735e6eee06" released by "delete_snapshot" :: held 2.383s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:29:05 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "cinder-quobyte-2390f21c-93fa-466e-9588-da2bf27761bc" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:29:05 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-2390f21c-93fa-466e-9588-da2bf27761bc" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:29:05 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "cinder-quobyte-d86198d0-e62b-47c2-be7b-5f0827ea35a2" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:29:05 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-d86198d0-e62b-47c2-be7b-5f0827ea35a2" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:29:05 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Deleting offline snapshot d86198d0-e62b-47c2-be7b-5f0827ea35a2 of volume 2390f21c-93fa-466e-9588-da2bf27761bc {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:29:05 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] snapshot_file for this snap is: volume-2390f21c-93fa-466e-9588-da2bf27761bc.d86198d0-e62b-47c2-be7b-5f0827ea35a2 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:29:05 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8257bd-9571-40b8-a3f9-79bff604b74d]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:29:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc.d86198d0-e62b-47c2-be7b-5f0827ea35a2 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:06 devstack sudo[84735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc.d86198d0-e62b-47c2-be7b-5f0827ea35a2 Feb 27 12:29:06 devstack sudo[84735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:06 devstack sudo[84735]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc.d86198d0-e62b-47c2-be7b-5f0827ea35a2" returned: 0 in 0.664s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:06 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2390f21c-93fa-466e-9588-da2bf27761bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:29:06 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[236f1be8-2427-494a-a5ad-332fcf786d34]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:29:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:06 devstack sudo[84740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc Feb 27 12:29:06 devstack sudo[84740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:07 devstack sudo[84740]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc" returned: 0 in 0.605s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc.d86198d0-e62b-47c2-be7b-5f0827ea35a2 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:07 devstack sudo[84746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc.d86198d0-e62b-47c2-be7b-5f0827ea35a2 Feb 27 12:29:07 devstack sudo[84746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:08 devstack sudo[84746]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc.d86198d0-e62b-47c2-be7b-5f0827ea35a2" returned: 0 in 0.793s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc.d86198d0-e62b-47c2-be7b-5f0827ea35a2 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:08 devstack sudo[84751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc.d86198d0-e62b-47c2-be7b-5f0827ea35a2 Feb 27 12:29:08 devstack sudo[84751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:08 devstack sudo[84751]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc.d86198d0-e62b-47c2-be7b-5f0827ea35a2" returned: 0 in 0.683s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:08 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-d86198d0-e62b-47c2-be7b-5f0827ea35a2" released by "_delete_snapshot" :: held 2.806s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:29:08 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-2390f21c-93fa-466e-9588-da2bf27761bc" released by "delete_snapshot" :: held 2.820s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:29:08 devstack cinder-volume[83077]: DEBUG dbcounter [-] [83077] Writing DB stats cinder:UPDATE=118,cinder:SELECT=133,cinder:INSERT=28,cinder:DELETE=3 {{(pid=83077) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:29:08 devstack cinder-volume[83077]: WARNING cinder.quota [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-856494847 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-856494847, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:29:08 devstack cinder-volume[83077]: WARNING cinder.quota [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-856494847 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-856494847, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:29:08 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Created reservations ['7afe7cd0-def3-4965-9a1d-82408f6d7ad7', 'e338c043-a507-4e69-9702-bf2ba1ff237f', '95e3bbaa-8a8d-4b94-919c-54f838b6eed1', '68e90918-822a-4f4c-9f59-46f47f9bfe68'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:29:08 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] Created reservations ['2da86c10-ac26-41c8-b0a3-0a203209720a', 'd8b9b7e3-19ea-4c38-9a0d-bab7f547219b', '1fd261a4-2902-44a4-9b9b-35b2ea8bc60e', '36b4aa3e-deca-41c0-8ce4-2651d22504d2'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:29:09 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-97d455ad-e6cf-46a2-9658-375d46df24d4 tempest-GroupSnapshotsTest-1932635372 None] group_snapshot 4d02aa34-a8da-485c-bdd1-7f4d460cab2f: deleted successfully Feb 27 12:29:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7aeb58a4-f918-4dcd-9f53-5f681fd83e94 tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "cinder-quobyte-2390f21c-93fa-466e-9588-da2bf27761bc" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:29:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7aeb58a4-f918-4dcd-9f53-5f681fd83e94 tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-2390f21c-93fa-466e-9588-da2bf27761bc" acquired by "delete_volume" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:29:10 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[7078d9f0-446c-43e0-90df-933caa72591e]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:29:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7aeb58a4-f918-4dcd-9f53-5f681fd83e94 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:10 devstack sudo[84757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc Feb 27 12:29:10 devstack sudo[84757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:10 devstack sudo[84757]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7aeb58a4-f918-4dcd-9f53-5f681fd83e94 tempest-GroupSnapshotsTest-1932635372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc" returned: 0 in 0.566s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7aeb58a4-f918-4dcd-9f53-5f681fd83e94 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:10 devstack sudo[84765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc Feb 27 12:29:10 devstack sudo[84765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:11 devstack sudo[84765]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7aeb58a4-f918-4dcd-9f53-5f681fd83e94 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2390f21c-93fa-466e-9588-da2bf27761bc" returned: 0 in 0.488s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:11 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7aeb58a4-f918-4dcd-9f53-5f681fd83e94 tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-2390f21c-93fa-466e-9588-da2bf27761bc" released by "delete_volume" :: held 1.096s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:29:11 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7aeb58a4-f918-4dcd-9f53-5f681fd83e94 tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "cinder-quobyte-fa10aa1e-7753-494e-b3bd-ea735e6eee06" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:29:11 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7aeb58a4-f918-4dcd-9f53-5f681fd83e94 tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-fa10aa1e-7753-494e-b3bd-ea735e6eee06" acquired by "delete_volume" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:29:11 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76c8e88-863f-4400-b1fd-710d3deb6846]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:29:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7aeb58a4-f918-4dcd-9f53-5f681fd83e94 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:11 devstack sudo[84775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06 Feb 27 12:29:11 devstack sudo[84775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:11 devstack sudo[84775]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7aeb58a4-f918-4dcd-9f53-5f681fd83e94 tempest-GroupSnapshotsTest-1932635372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06" returned: 0 in 0.650s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7aeb58a4-f918-4dcd-9f53-5f681fd83e94 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:12 devstack sudo[84813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06 Feb 27 12:29:12 devstack sudo[84813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:13 devstack sudo[84813]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7aeb58a4-f918-4dcd-9f53-5f681fd83e94 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fa10aa1e-7753-494e-b3bd-ea735e6eee06" returned: 0 in 1.103s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:13 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7aeb58a4-f918-4dcd-9f53-5f681fd83e94 tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-fa10aa1e-7753-494e-b3bd-ea735e6eee06" released by "delete_volume" :: held 1.796s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:29:13 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-7aeb58a4-f918-4dcd-9f53-5f681fd83e94 tempest-GroupSnapshotsTest-1932635372 None] Created reservations ['62392e70-7578-4cf7-b14b-342cade86f45'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:29:13 devstack cinder-volume[83077]: WARNING cinder.quota [None req-7aeb58a4-f918-4dcd-9f53-5f681fd83e94 tempest-GroupSnapshotsTest-1932635372 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-856494847 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-856494847, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:29:13 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-7aeb58a4-f918-4dcd-9f53-5f681fd83e94 tempest-GroupSnapshotsTest-1932635372 None] Created reservations ['837d14f9-4ad4-4f30-a70b-0241ca105acf', '615a3422-a683-4dc3-8b0d-6339d920c0df', '6741240f-a26c-467d-96e5-b417b7884a76', '557eabd9-691e-451c-afcc-8ed7262161ad'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:29:13 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-7aeb58a4-f918-4dcd-9f53-5f681fd83e94 tempest-GroupSnapshotsTest-1932635372 None] Created reservations ['b8a247cb-19c3-4100-9747-45c71d552ed2', 'b398f846-8c1e-41c1-9e72-c379af1f72cb', '82c4483b-38ec-45c1-b8af-9a9919e72293', 'c444de0b-2d79-4643-9b31-873705894c45'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:29:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7aeb58a4-f918-4dcd-9f53-5f681fd83e94 tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7aeb58a4-f918-4dcd-9f53-5f681fd83e94 tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:13 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7aeb58a4-f918-4dcd-9f53-5f681fd83e94 tempest-GroupSnapshotsTest-1932635372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:29:13 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7aeb58a4-f918-4dcd-9f53-5f681fd83e94 tempest-GroupSnapshotsTest-1932635372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:29:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7aeb58a4-f918-4dcd-9f53-5f681fd83e94 tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7aeb58a4-f918-4dcd-9f53-5f681fd83e94 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:13 devstack sudo[84840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:29:13 devstack sudo[84840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:14 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-491e9e6c-40fd-48b9-9542-c9e26cbfc30f tempest-GroupSnapshotsTest-1932635372 None] Group tempest-GroupSnapshotsTest-Group-1864169446: creating Feb 27 12:29:14 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-491e9e6c-40fd-48b9-9542-c9e26cbfc30f tempest-GroupSnapshotsTest-1932635372 None] Group tempest-GroupSnapshotsTest-Group-1864169446: created successfully Feb 27 12:29:14 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-491e9e6c-40fd-48b9-9542-c9e26cbfc30f tempest-GroupSnapshotsTest-1932635372 None] Create group completed successfully. Feb 27 12:29:14 devstack sudo[84840]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7aeb58a4-f918-4dcd-9f53-5f681fd83e94 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.737s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:14 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-7aeb58a4-f918-4dcd-9f53-5f681fd83e94 tempest-GroupSnapshotsTest-1932635372 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:29:14 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-7aeb58a4-f918-4dcd-9f53-5f681fd83e94 tempest-GroupSnapshotsTest-1932635372 None] Delete group completed successfully. Feb 27 12:29:15 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:29:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Flow 'volume_create_manager' (99b0efd9-b454-4fc9-8b68-05e2c0a0f092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:29:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (875136d9-8975-42e1-b0f9-250e8f8dbf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (875136d9-8975-42e1-b0f9-250e8f8dbf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-327641912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3946418-a4b0-48f2-bdcd-7b6a99c29404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='712f8696ffed46deb260f4af0a101dbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:29:15Z,use_quota=True,user_id='32457f7f86c44ffb80e4f33245b8080a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b61afbb1-b83f-4f36-a3e0-e3716e434b11),volume_type_id=b61afbb1-b83f-4f36-a3e0-e3716e434b11)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba988b6a-179e-470b-a8e9-4762d5a09c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba988b6a-179e-470b-a8e9-4762d5a09c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c2cac9-1318-472a-adfe-e197570462da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c2cac9-1318-472a-adfe-e197570462da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3946418-a4b0-48f2-bdcd-7b6a99c29404', 'volume_name': 'volume-f3946418-a4b0-48f2-bdcd-7b6a99c29404', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34756783-def6-4f9e-a981-80b486146def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34756783-def6-4f9e-a981-80b486146def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4e3981-2f52-437d-b2d1-9c0f4044ae63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:15 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Volume f3946418-a4b0-48f2-bdcd-7b6a99c29404: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3946418-a4b0-48f2-bdcd-7b6a99c29404', 'volume_size': 1} Feb 27 12:29:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-327641912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3946418-a4b0-48f2-bdcd-7b6a99c29404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='712f8696ffed46deb260f4af0a101dbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:29:15Z,use_quota=True,user_id='32457f7f86c44ffb80e4f33245b8080a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b61afbb1-b83f-4f36-a3e0-e3716e434b11),volume_type_id=b61afbb1-b83f-4f36-a3e0-e3716e434b11)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:29:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Creating volume f3946418-a4b0-48f2-bdcd-7b6a99c29404 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:29:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:29:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:29:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:29:15 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:29:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f3946418-a4b0-48f2-bdcd-7b6a99c29404 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:15 devstack sudo[84844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f3946418-a4b0-48f2-bdcd-7b6a99c29404 1073741824 Feb 27 12:29:15 devstack sudo[84844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:16 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:29:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Flow 'volume_create_manager' (65b3b41e-26cb-4b42-b529-27d51aad9022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:29:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79abd04c-5f11-4a5b-8fca-7e031ac88fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:16 devstack cinder-volume[83077]: DEBUG dbcounter [-] [83077] Writing DB stats cinder:SELECT=153,cinder:UPDATE=168,cinder:INSERT=36,cinder:DELETE=11 {{(pid=83077) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:29:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79abd04c-5f11-4a5b-8fca-7e031ac88fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2063234801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8c969fcf-c3af-4a9b-ad7b-b1f60db6c314,host='devstack@QuobyteHD#QuobyteHD',id=2b8b8b86-4d8b-4840-8d24-2a35073e9899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56278194745946eea7d8b1ee011abce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:29:16Z,use_quota=True,user_id='31ea13b75a134b1190251920fb03c0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba30372f-904f-480d-be0e-5baa1842dc25),volume_type_id=ba30372f-904f-480d-be0e-5baa1842dc25)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d128d5c1-9633-40a8-bf50-a9f1372e5245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d128d5c1-9633-40a8-bf50-a9f1372e5245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf93e2fe-8ef7-48db-a55b-d06b9e7e35cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf93e2fe-8ef7-48db-a55b-d06b9e7e35cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b8b8b86-4d8b-4840-8d24-2a35073e9899', 'volume_name': 'volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abbb2964-0210-4fd2-b287-208b4f19d873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abbb2964-0210-4fd2-b287-208b4f19d873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba48a76-55b4-4344-8ffd-7686cc46fc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:16 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Volume 2b8b8b86-4d8b-4840-8d24-2a35073e9899: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899', 'volume_size': 1} Feb 27 12:29:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:17 devstack sudo[84844]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f3946418-a4b0-48f2-bdcd-7b6a99c29404 1073741824" returned: 0 in 1.677s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f3946418-a4b0-48f2-bdcd-7b6a99c29404 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:17 devstack sudo[84867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f3946418-a4b0-48f2-bdcd-7b6a99c29404 Feb 27 12:29:17 devstack sudo[84867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:17 devstack sudo[84867]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f3946418-a4b0-48f2-bdcd-7b6a99c29404" returned: 0 in 0.529s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:17 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] <== create_volume: return (2238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:29:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.240s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.249s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:17 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8c969fcf-c3af-4a9b-ad7b-b1f60db6c314,created_at=2026-02-27T11:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2063234801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8c969fcf-c3af-4a9b-ad7b-b1f60db6c314,host='devstack@QuobyteHD#QuobyteHD',id=2b8b8b86-4d8b-4840-8d24-2a35073e9899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56278194745946eea7d8b1ee011abce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:29:16Z,use_quota=True,user_id='31ea13b75a134b1190251920fb03c0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba30372f-904f-480d-be0e-5baa1842dc25),volume_type_id=ba30372f-904f-480d-be0e-5baa1842dc25)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:29:17 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Creating volume 2b8b8b86-4d8b-4840-8d24-2a35073e9899 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:29:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:17 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:29:17 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:29:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:17 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:29:17 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:29:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4e3981-2f52-437d-b2d1-9c0f4044ae63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3946418-a4b0-48f2-bdcd-7b6a99c29404', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd9408d-eec8-4542-9715-268c273fb784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:17 devstack sudo[84870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899 1073741824 Feb 27 12:29:17 devstack sudo[84870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:17 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Volume volume-f3946418-a4b0-48f2-bdcd-7b6a99c29404 (f3946418-a4b0-48f2-bdcd-7b6a99c29404): created successfully Feb 27 12:29:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd9408d-eec8-4542-9715-268c273fb784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Flow 'volume_create_manager' (99b0efd9-b454-4fc9-8b68-05e2c0a0f092) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:29:17 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-79de614e-3861-4443-9d3b-ea74fcc29598 tempest-VolumeTypesAccessTest-22918462 None] Created volume successfully. Feb 27 12:29:18 devstack sudo[84870]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899 1073741824" returned: 0 in 0.661s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:18 devstack sudo[84875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899 Feb 27 12:29:18 devstack sudo[84875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:18 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-389f75bc-5148-49c4-8713-ff97cb8e1ffb tempest-VolumeTypesAccessTest-22918462 None] Acquiring lock "cinder-f3946418-a4b0-48f2-bdcd-7b6a99c29404-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:29:18 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-389f75bc-5148-49c4-8713-ff97cb8e1ffb tempest-VolumeTypesAccessTest-22918462 None] Lock "cinder-f3946418-a4b0-48f2-bdcd-7b6a99c29404-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:29:18 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-389f75bc-5148-49c4-8713-ff97cb8e1ffb tempest-VolumeTypesAccessTest-22918462 None] Acquiring lock "cinder-quobyte-f3946418-a4b0-48f2-bdcd-7b6a99c29404" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:29:18 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-389f75bc-5148-49c4-8713-ff97cb8e1ffb tempest-VolumeTypesAccessTest-22918462 None] Lock "cinder-quobyte-f3946418-a4b0-48f2-bdcd-7b6a99c29404" acquired by "delete_volume" :: waited 0.031s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:29:19 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[80674cb7-e3f4-4552-a29f-04c55dc873bc]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:29:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-389f75bc-5148-49c4-8713-ff97cb8e1ffb tempest-VolumeTypesAccessTest-22918462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f3946418-a4b0-48f2-bdcd-7b6a99c29404 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:19 devstack sudo[84875]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899" returned: 0 in 0.819s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:29:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba48a76-55b4-4344-8ffd-7686cc46fc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91d191c6-b1a5-42b2-b70e-c865b90ae4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:19 devstack sudo[84885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f3946418-a4b0-48f2-bdcd-7b6a99c29404 Feb 27 12:29:19 devstack sudo[84885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:19 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Volume volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899 (2b8b8b86-4d8b-4840-8d24-2a35073e9899): created successfully Feb 27 12:29:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91d191c6-b1a5-42b2-b70e-c865b90ae4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Flow 'volume_create_manager' (65b3b41e-26cb-4b42-b529-27d51aad9022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:29:19 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-673aad07-3f1b-481d-bfab-616b7c20e7fd tempest-GroupSnapshotsTest-1932635372 None] Created volume successfully. Feb 27 12:29:19 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-5de93489-e4c0-419a-9670-eabc31eac98e tempest-GroupSnapshotsTest-1932635372 None] GroupSnapshot 08ab2c1f-618a-4116-824b-dc27fbef4144: creating. Feb 27 12:29:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-5de93489-e4c0-419a-9670-eabc31eac98e tempest-GroupSnapshotsTest-1932635372 None] Group snapshot 08ab2c1f-618a-4116-824b-dc27fbef4144: creating. {{(pid=83077) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 12:29:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-5de93489-e4c0-419a-9670-eabc31eac98e tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-5de93489-e4c0-419a-9670-eabc31eac98e tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-5de93489-e4c0-419a-9670-eabc31eac98e tempest-GroupSnapshotsTest-1932635372 None] Creating offline snapshot 2b63ac85-e2a2-4805-8b74-30121f6d31f3 of volume 2b8b8b86-4d8b-4840-8d24-2a35073e9899 {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:29:19 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8abebc9-02b9-4678-9050-3c8dd21fd76c]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:29:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5de93489-e4c0-419a-9670-eabc31eac98e tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:19 devstack sudo[84892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899 Feb 27 12:29:19 devstack sudo[84892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:20 devstack sudo[84885]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-389f75bc-5148-49c4-8713-ff97cb8e1ffb tempest-VolumeTypesAccessTest-22918462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f3946418-a4b0-48f2-bdcd-7b6a99c29404" returned: 0 in 1.236s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-389f75bc-5148-49c4-8713-ff97cb8e1ffb tempest-VolumeTypesAccessTest-22918462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f3946418-a4b0-48f2-bdcd-7b6a99c29404 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:20 devstack sudo[84901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f3946418-a4b0-48f2-bdcd-7b6a99c29404 Feb 27 12:29:20 devstack sudo[84901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:20 devstack sudo[84892]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5de93489-e4c0-419a-9670-eabc31eac98e tempest-GroupSnapshotsTest-1932635372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899" returned: 0 in 0.791s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5de93489-e4c0-419a-9670-eabc31eac98e tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899.2b63ac85-e2a2-4805-8b74-30121f6d31f3 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:20 devstack sudo[84906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899.2b63ac85-e2a2-4805-8b74-30121f6d31f3 1G Feb 27 12:29:20 devstack sudo[84906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:20 devstack sudo[84901]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-389f75bc-5148-49c4-8713-ff97cb8e1ffb tempest-VolumeTypesAccessTest-22918462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f3946418-a4b0-48f2-bdcd-7b6a99c29404" returned: 0 in 0.697s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:20 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-389f75bc-5148-49c4-8713-ff97cb8e1ffb tempest-VolumeTypesAccessTest-22918462 None] Lock "cinder-quobyte-f3946418-a4b0-48f2-bdcd-7b6a99c29404" released by "delete_volume" :: held 2.034s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:29:20 devstack cinder-volume[83077]: WARNING cinder.quota [None req-389f75bc-5148-49c4-8713-ff97cb8e1ffb tempest-VolumeTypesAccessTest-22918462 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1657250548 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1657250548, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:29:20 devstack cinder-volume[83077]: WARNING cinder.quota [None req-389f75bc-5148-49c4-8713-ff97cb8e1ffb tempest-VolumeTypesAccessTest-22918462 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1657250548 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1657250548, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:29:20 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-389f75bc-5148-49c4-8713-ff97cb8e1ffb tempest-VolumeTypesAccessTest-22918462 None] Created reservations ['1bf8d176-54d9-47f4-9dd1-94e43f9a7740', '87fc9752-365f-45d1-ac12-b949ac91fba5', 'ba440f25-2066-4eeb-b1f7-64b7ec255d51', '62e372ef-8021-4fb4-8bd8-96d2df254ab7'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:29:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-389f75bc-5148-49c4-8713-ff97cb8e1ffb tempest-VolumeTypesAccessTest-22918462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-389f75bc-5148-49c4-8713-ff97cb8e1ffb tempest-VolumeTypesAccessTest-22918462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:21 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-389f75bc-5148-49c4-8713-ff97cb8e1ffb tempest-VolumeTypesAccessTest-22918462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:29:21 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-389f75bc-5148-49c4-8713-ff97cb8e1ffb tempest-VolumeTypesAccessTest-22918462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:29:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-389f75bc-5148-49c4-8713-ff97cb8e1ffb tempest-VolumeTypesAccessTest-22918462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-389f75bc-5148-49c4-8713-ff97cb8e1ffb tempest-VolumeTypesAccessTest-22918462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:21 devstack sudo[84910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:29:21 devstack sudo[84910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:21 devstack sudo[84910]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-389f75bc-5148-49c4-8713-ff97cb8e1ffb tempest-VolumeTypesAccessTest-22918462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.571s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:21 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-389f75bc-5148-49c4-8713-ff97cb8e1ffb tempest-VolumeTypesAccessTest-22918462 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:29:21 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-389f75bc-5148-49c4-8713-ff97cb8e1ffb tempest-VolumeTypesAccessTest-22918462 None] Deleted volume successfully. Feb 27 12:29:21 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-389f75bc-5148-49c4-8713-ff97cb8e1ffb tempest-VolumeTypesAccessTest-22918462 None] Lock "cinder-f3946418-a4b0-48f2-bdcd-7b6a99c29404-delete_volume" released by "delete_volume" :: held 2.818s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:29:21 devstack sudo[84906]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5de93489-e4c0-419a-9670-eabc31eac98e tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899.2b63ac85-e2a2-4805-8b74-30121f6d31f3 1G" returned: 0 in 1.106s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5de93489-e4c0-419a-9670-eabc31eac98e tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899.2b63ac85-e2a2-4805-8b74-30121f6d31f3 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:21 devstack sudo[84937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899.2b63ac85-e2a2-4805-8b74-30121f6d31f3 Feb 27 12:29:21 devstack sudo[84937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:22 devstack sudo[84937]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5de93489-e4c0-419a-9670-eabc31eac98e tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899.2b63ac85-e2a2-4805-8b74-30121f6d31f3" returned: 0 in 0.888s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:22 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-5de93489-e4c0-419a-9670-eabc31eac98e tempest-GroupSnapshotsTest-1932635372 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899.2b63ac85-e2a2-4805-8b74-30121f6d31f3 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 12:29:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5de93489-e4c0-419a-9670-eabc31eac98e tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899.2b63ac85-e2a2-4805-8b74-30121f6d31f3 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:22 devstack sudo[84965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899.2b63ac85-e2a2-4805-8b74-30121f6d31f3 Feb 27 12:29:22 devstack sudo[84965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:23 devstack sudo[84965]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5de93489-e4c0-419a-9670-eabc31eac98e tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899.2b63ac85-e2a2-4805-8b74-30121f6d31f3" returned: 0 in 1.207s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5de93489-e4c0-419a-9670-eabc31eac98e tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:23 devstack sudo[84977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899.info Feb 27 12:29:23 devstack sudo[84977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:24 devstack sudo[84977]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5de93489-e4c0-419a-9670-eabc31eac98e tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899.info" returned: 0 in 0.752s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:24 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-5de93489-e4c0-419a-9670-eabc31eac98e tempest-GroupSnapshotsTest-1932635372 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 12:29:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5de93489-e4c0-419a-9670-eabc31eac98e tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:24 devstack sudo[84981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899.info Feb 27 12:29:24 devstack sudo[84981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:25 devstack sudo[84981]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5de93489-e4c0-419a-9670-eabc31eac98e tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899.info" returned: 0 in 0.612s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-5de93489-e4c0-419a-9670-eabc31eac98e tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.464s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:25 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-5de93489-e4c0-419a-9670-eabc31eac98e tempest-GroupSnapshotsTest-1932635372 None] group_snapshot 08ab2c1f-618a-4116-824b-dc27fbef4144: created successfully Feb 27 12:29:26 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-cba7bf84-2863-42bd-815b-b3fed5c02e44 tempest-GroupSnapshotsTest-1932635372 None] group_snapshot 08ab2c1f-618a-4116-824b-dc27fbef4144: deleting Feb 27 12:29:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cba7bf84-2863-42bd-815b-b3fed5c02e44 tempest-GroupSnapshotsTest-1932635372 None] group_snapshot 08ab2c1f-618a-4116-824b-dc27fbef4144: deleting {{(pid=83077) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 12:29:26 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cba7bf84-2863-42bd-815b-b3fed5c02e44 tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "cinder-quobyte-2b8b8b86-4d8b-4840-8d24-2a35073e9899" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:29:26 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cba7bf84-2863-42bd-815b-b3fed5c02e44 tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-2b8b8b86-4d8b-4840-8d24-2a35073e9899" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:29:26 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cba7bf84-2863-42bd-815b-b3fed5c02e44 tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "cinder-quobyte-2b63ac85-e2a2-4805-8b74-30121f6d31f3" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:29:26 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cba7bf84-2863-42bd-815b-b3fed5c02e44 tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-2b63ac85-e2a2-4805-8b74-30121f6d31f3" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:29:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-cba7bf84-2863-42bd-815b-b3fed5c02e44 tempest-GroupSnapshotsTest-1932635372 None] Deleting offline snapshot 2b63ac85-e2a2-4805-8b74-30121f6d31f3 of volume 2b8b8b86-4d8b-4840-8d24-2a35073e9899 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:29:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-cba7bf84-2863-42bd-815b-b3fed5c02e44 tempest-GroupSnapshotsTest-1932635372 None] snapshot_file for this snap is: volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899.2b63ac85-e2a2-4805-8b74-30121f6d31f3 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:29:26 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5b282c-3b40-44bd-b7f2-13075ce836ff]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:29:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cba7bf84-2863-42bd-815b-b3fed5c02e44 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899.2b63ac85-e2a2-4805-8b74-30121f6d31f3 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:26 devstack sudo[85024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899.2b63ac85-e2a2-4805-8b74-30121f6d31f3 Feb 27 12:29:26 devstack sudo[85024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:27 devstack sudo[85024]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cba7bf84-2863-42bd-815b-b3fed5c02e44 tempest-GroupSnapshotsTest-1932635372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899.2b63ac85-e2a2-4805-8b74-30121f6d31f3" returned: 0 in 0.727s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-cba7bf84-2863-42bd-815b-b3fed5c02e44 tempest-GroupSnapshotsTest-1932635372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:29:27 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd786ce-f407-490a-9756-6915fbda9a08]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:29:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cba7bf84-2863-42bd-815b-b3fed5c02e44 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:27 devstack sudo[85030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899 Feb 27 12:29:27 devstack sudo[85030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:28 devstack sudo[85030]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cba7bf84-2863-42bd-815b-b3fed5c02e44 tempest-GroupSnapshotsTest-1932635372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899" returned: 0 in 1.111s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cba7bf84-2863-42bd-815b-b3fed5c02e44 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899.2b63ac85-e2a2-4805-8b74-30121f6d31f3 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:28 devstack sudo[85063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899.2b63ac85-e2a2-4805-8b74-30121f6d31f3 Feb 27 12:29:28 devstack sudo[85063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:29 devstack sudo[85063]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cba7bf84-2863-42bd-815b-b3fed5c02e44 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899.2b63ac85-e2a2-4805-8b74-30121f6d31f3" returned: 0 in 0.856s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cba7bf84-2863-42bd-815b-b3fed5c02e44 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899.2b63ac85-e2a2-4805-8b74-30121f6d31f3 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:29 devstack sudo[85069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899.2b63ac85-e2a2-4805-8b74-30121f6d31f3 Feb 27 12:29:29 devstack sudo[85069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:30 devstack sudo[85069]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cba7bf84-2863-42bd-815b-b3fed5c02e44 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899.2b63ac85-e2a2-4805-8b74-30121f6d31f3" returned: 0 in 0.785s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:30 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cba7bf84-2863-42bd-815b-b3fed5c02e44 tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-2b63ac85-e2a2-4805-8b74-30121f6d31f3" released by "_delete_snapshot" :: held 3.630s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:29:30 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cba7bf84-2863-42bd-815b-b3fed5c02e44 tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-2b8b8b86-4d8b-4840-8d24-2a35073e9899" released by "delete_snapshot" :: held 3.647s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:29:30 devstack cinder-volume[83077]: WARNING cinder.quota [None req-cba7bf84-2863-42bd-815b-b3fed5c02e44 tempest-GroupSnapshotsTest-1932635372 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-623412180 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-623412180, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:29:30 devstack cinder-volume[83077]: WARNING cinder.quota [None req-cba7bf84-2863-42bd-815b-b3fed5c02e44 tempest-GroupSnapshotsTest-1932635372 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-623412180 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-623412180, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:29:30 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-cba7bf84-2863-42bd-815b-b3fed5c02e44 tempest-GroupSnapshotsTest-1932635372 None] Created reservations ['f4cf3918-08f3-421f-8269-70c63df2cb3c', '148d7b05-2f0c-4a30-9895-c206dabddf39', 'f0160251-47cc-4eed-bac2-8727a9881842', '67b436eb-c467-4417-a25d-227e212f4ae4'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:29:30 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-cba7bf84-2863-42bd-815b-b3fed5c02e44 tempest-GroupSnapshotsTest-1932635372 None] group_snapshot 08ab2c1f-618a-4116-824b-dc27fbef4144: deleted successfully Feb 27 12:29:31 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:29:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Flow 'volume_create_manager' (66e285d3-9b86-4d30-927e-ac1e8629156e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:29:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba58bc1f-d98b-4fb9-abdb-8f4da360b9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba58bc1f-d98b-4fb9-abdb-8f4da360b9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-158283946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff4faff-61e1-4bdf-b381-e077f1a2dc8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0c5e60991d44ce0970bb48b36a7a55e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:29:31Z,use_quota=True,user_id='b3b8db921f944fa7aa7d6a0d9dbd78af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2447a3c9-04df-42e2-82d1-20f474dcd921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2447a3c9-04df-42e2-82d1-20f474dcd921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939ced6e-df47-44df-8311-e195792e6bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939ced6e-df47-44df-8311-e195792e6bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fff4faff-61e1-4bdf-b381-e077f1a2dc8b', 'volume_name': 'volume-fff4faff-61e1-4bdf-b381-e077f1a2dc8b', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64570b88-2bdc-4f65-83bb-2862a4d85c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64570b88-2bdc-4f65-83bb-2862a4d85c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274c2219-e4d0-4853-8a44-52010e687bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:31 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Volume fff4faff-61e1-4bdf-b381-e077f1a2dc8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fff4faff-61e1-4bdf-b381-e077f1a2dc8b', 'volume_size': 1} Feb 27 12:29:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:31 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-158283946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff4faff-61e1-4bdf-b381-e077f1a2dc8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0c5e60991d44ce0970bb48b36a7a55e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:29:31Z,use_quota=True,user_id='b3b8db921f944fa7aa7d6a0d9dbd78af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:29:31 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Creating volume fff4faff-61e1-4bdf-b381-e077f1a2dc8b {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:29:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:31 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:29:31 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:29:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:31 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:29:31 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:29:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fff4faff-61e1-4bdf-b381-e077f1a2dc8b 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:31 devstack sudo[85094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fff4faff-61e1-4bdf-b381-e077f1a2dc8b 1073741824 Feb 27 12:29:31 devstack sudo[85094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-423439ed-3031-4b04-b000-d91823ad8e56 tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "cinder-quobyte-2b8b8b86-4d8b-4840-8d24-2a35073e9899" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:29:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-423439ed-3031-4b04-b000-d91823ad8e56 tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-2b8b8b86-4d8b-4840-8d24-2a35073e9899" acquired by "delete_volume" :: waited 0.021s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:29:31 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c972d69-79d2-43cf-89fc-149824ec61c2]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:29:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-423439ed-3031-4b04-b000-d91823ad8e56 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:31 devstack sudo[85096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899 Feb 27 12:29:31 devstack sudo[85096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:32 devstack sudo[85096]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-423439ed-3031-4b04-b000-d91823ad8e56 tempest-GroupSnapshotsTest-1932635372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899" returned: 0 in 1.267s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-423439ed-3031-4b04-b000-d91823ad8e56 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:32 devstack sudo[85105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899 Feb 27 12:29:32 devstack sudo[85105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:33 devstack sudo[85094]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fff4faff-61e1-4bdf-b381-e077f1a2dc8b 1073741824" returned: 0 in 1.790s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fff4faff-61e1-4bdf-b381-e077f1a2dc8b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:33 devstack sudo[85107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fff4faff-61e1-4bdf-b381-e077f1a2dc8b Feb 27 12:29:33 devstack sudo[85107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:33 devstack sudo[85105]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-423439ed-3031-4b04-b000-d91823ad8e56 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2b8b8b86-4d8b-4840-8d24-2a35073e9899" returned: 0 in 0.944s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:33 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-423439ed-3031-4b04-b000-d91823ad8e56 tempest-GroupSnapshotsTest-1932635372 None] Lock "cinder-quobyte-2b8b8b86-4d8b-4840-8d24-2a35073e9899" released by "delete_volume" :: held 2.377s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:29:33 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-423439ed-3031-4b04-b000-d91823ad8e56 tempest-GroupSnapshotsTest-1932635372 None] Created reservations ['e3525451-c096-4b48-a39d-866e9b0ec9aa'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:29:34 devstack cinder-volume[83077]: WARNING cinder.quota [None req-423439ed-3031-4b04-b000-d91823ad8e56 tempest-GroupSnapshotsTest-1932635372 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-623412180 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-623412180, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:29:34 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-423439ed-3031-4b04-b000-d91823ad8e56 tempest-GroupSnapshotsTest-1932635372 None] Created reservations ['00522068-159e-43e2-b749-d9788c5eee78', '6e60c418-2b2d-4606-ae56-71851aae3cb7', 'cb6fdbbc-c23d-4c1a-b76c-8efb3f97cd34', 'a9290166-debd-4e5a-a6c3-f656adcc090f'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:29:34 devstack sudo[85107]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fff4faff-61e1-4bdf-b381-e077f1a2dc8b" returned: 0 in 1.030s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:34 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] <== create_volume: return (2924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:29:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.928s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:34 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274c2219-e4d0-4853-8a44-52010e687bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fff4faff-61e1-4bdf-b381-e077f1a2dc8b', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:34 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06822fd2-0c0e-4a07-9bf4-e80edbdfa12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:34 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Volume volume-fff4faff-61e1-4bdf-b381-e077f1a2dc8b (fff4faff-61e1-4bdf-b381-e077f1a2dc8b): created successfully Feb 27 12:29:34 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06822fd2-0c0e-4a07-9bf4-e80edbdfa12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:34 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Flow 'volume_create_manager' (66e285d3-9b86-4d30-927e-ac1e8629156e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:29:34 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-ce60f51a-c386-42a2-abfa-b1ca26824604 tempest-ServerRescueNegativeTestJSON-712914185 None] Created volume successfully. Feb 27 12:29:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-423439ed-3031-4b04-b000-d91823ad8e56 tempest-GroupSnapshotsTest-1932635372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-423439ed-3031-4b04-b000-d91823ad8e56 tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:34 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-423439ed-3031-4b04-b000-d91823ad8e56 tempest-GroupSnapshotsTest-1932635372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:29:34 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-423439ed-3031-4b04-b000-d91823ad8e56 tempest-GroupSnapshotsTest-1932635372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:29:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-423439ed-3031-4b04-b000-d91823ad8e56 tempest-GroupSnapshotsTest-1932635372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-423439ed-3031-4b04-b000-d91823ad8e56 tempest-GroupSnapshotsTest-1932635372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:34 devstack sudo[85112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:29:34 devstack sudo[85112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:35 devstack sudo[85112]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-423439ed-3031-4b04-b000-d91823ad8e56 tempest-GroupSnapshotsTest-1932635372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.850s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:35 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-423439ed-3031-4b04-b000-d91823ad8e56 tempest-GroupSnapshotsTest-1932635372 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:29:35 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-423439ed-3031-4b04-b000-d91823ad8e56 tempest-GroupSnapshotsTest-1932635372 None] Delete group completed successfully. Feb 27 12:29:42 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-8d4f0571-0828-41ed-a41f-aa49b55cf69b tempest-GroupsTest-2055894075 None] Group tempest-Group1-677522573: creating Feb 27 12:29:42 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-8d4f0571-0828-41ed-a41f-aa49b55cf69b tempest-GroupsTest-2055894075 None] Group tempest-Group1-677522573: created successfully Feb 27 12:29:42 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-8d4f0571-0828-41ed-a41f-aa49b55cf69b tempest-GroupsTest-2055894075 None] Create group completed successfully. Feb 27 12:29:43 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-0ee750b4-6625-4746-8c0d-2b5f4b27c940 tempest-GroupsTest-2055894075 None] Group tempest-Group2-1071978066: creating Feb 27 12:29:43 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-0ee750b4-6625-4746-8c0d-2b5f4b27c940 tempest-GroupsTest-2055894075 None] Group tempest-Group2-1071978066: created successfully Feb 27 12:29:43 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-0ee750b4-6625-4746-8c0d-2b5f4b27c940 tempest-GroupsTest-2055894075 None] Create group completed successfully. Feb 27 12:29:44 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:29:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Flow 'volume_create_manager' (8f3297b9-f722-4b22-b5b0-2b95a808cd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:29:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cecba295-d256-40e2-a012-ae534996ad3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cecba295-d256-40e2-a012-ae534996ad3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-18242858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=773fcd1e-1df5-413e-8a9b-dc5ea63a8b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dc0655bba354b6cbf0d7c33d7a4afa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:29:44Z,use_quota=True,user_id='cdfccbe5221d4c98ba2a74ac10030df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce57915-560f-4430-9279-228f4f690969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce57915-560f-4430-9279-228f4f690969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d5339db-f2bd-4874-9752-c3d8ffb3e423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d5339db-f2bd-4874-9752-c3d8ffb3e423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '773fcd1e-1df5-413e-8a9b-dc5ea63a8b13', 'volume_name': 'volume-773fcd1e-1df5-413e-8a9b-dc5ea63a8b13', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e76ecd-f0e1-4730-9635-9be29c57a34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e76ecd-f0e1-4730-9635-9be29c57a34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63070aa-abfe-4ba8-8640-dac6ff5515aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:44 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Volume 773fcd1e-1df5-413e-8a9b-dc5ea63a8b13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-773fcd1e-1df5-413e-8a9b-dc5ea63a8b13', 'volume_size': 1} Feb 27 12:29:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:44 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-18242858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=773fcd1e-1df5-413e-8a9b-dc5ea63a8b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dc0655bba354b6cbf0d7c33d7a4afa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:29:44Z,use_quota=True,user_id='cdfccbe5221d4c98ba2a74ac10030df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:29:44 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Creating volume 773fcd1e-1df5-413e-8a9b-dc5ea63a8b13 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:29:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:44 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:29:44 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:29:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:44 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:29:44 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:29:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-773fcd1e-1df5-413e-8a9b-dc5ea63a8b13 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:44 devstack sudo[85195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-773fcd1e-1df5-413e-8a9b-dc5ea63a8b13 1073741824 Feb 27 12:29:44 devstack sudo[85195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:45 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:29:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Flow 'volume_create_manager' (e4beefac-4ae0-45fa-ba5d-186562257008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:29:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f817b9a-0f0e-475e-bc80-42617f4383d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f817b9a-0f0e-475e-bc80-42617f4383d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1226720058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c7a79920-ddce-4358-9d22-ae35303aa590,host='devstack@QuobyteHD#QuobyteHD',id=4a734caf-48c4-41c5-ba70-67ad90bf504e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb574aaad53e43e9856fac15f69ed04e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:29:45Z,use_quota=True,user_id='fff0588b781f42ab8fd6195cc7f9f9af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4250f985-f8b2-491a-a04a-4a9ea520dfe6),volume_type_id=4250f985-f8b2-491a-a04a-4a9ea520dfe6)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22be1ec8-0776-4661-8fc8-345c2cbe3926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22be1ec8-0776-4661-8fc8-345c2cbe3926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e1abc4b-59c0-4622-9c89-ae6520fa645e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e1abc4b-59c0-4622-9c89-ae6520fa645e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a734caf-48c4-41c5-ba70-67ad90bf504e', 'volume_name': 'volume-4a734caf-48c4-41c5-ba70-67ad90bf504e', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b81b42-3cc0-4558-9d91-54a5d2e1207c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b81b42-3cc0-4558-9d91-54a5d2e1207c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517ec9a0-d637-4a46-8db9-ecb1ba8070b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:45 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Volume 4a734caf-48c4-41c5-ba70-67ad90bf504e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a734caf-48c4-41c5-ba70-67ad90bf504e', 'volume_size': 1} Feb 27 12:29:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:45 devstack sudo[85195]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-773fcd1e-1df5-413e-8a9b-dc5ea63a8b13 1073741824" returned: 0 in 1.117s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-773fcd1e-1df5-413e-8a9b-dc5ea63a8b13 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:45 devstack sudo[85200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-773fcd1e-1df5-413e-8a9b-dc5ea63a8b13 Feb 27 12:29:45 devstack sudo[85200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Flow 'volume_create_manager' (ea8b050c-b607-4642-9311-35db4fd1e75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7677a8e8-d5de-4990-bb0e-f09150dd1cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:46 devstack sudo[85200]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-773fcd1e-1df5-413e-8a9b-dc5ea63a8b13" returned: 0 in 0.903s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] <== create_volume: return (2054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.072s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.366s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c7a79920-ddce-4358-9d22-ae35303aa590,created_at=2026-02-27T11:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1226720058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c7a79920-ddce-4358-9d22-ae35303aa590,host='devstack@QuobyteHD#QuobyteHD',id=4a734caf-48c4-41c5-ba70-67ad90bf504e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb574aaad53e43e9856fac15f69ed04e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:29:45Z,use_quota=True,user_id='fff0588b781f42ab8fd6195cc7f9f9af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4250f985-f8b2-491a-a04a-4a9ea520dfe6),volume_type_id=4250f985-f8b2-491a-a04a-4a9ea520dfe6)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Creating volume 4a734caf-48c4-41c5-ba70-67ad90bf504e {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:29:46 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4a734caf-48c4-41c5-ba70-67ad90bf504e 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:46 devstack sudo[85231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4a734caf-48c4-41c5-ba70-67ad90bf504e 1073741824 Feb 27 12:29:46 devstack sudo[85231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7677a8e8-d5de-4990-bb0e-f09150dd1cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:29:46Z,deleted=False,deleted_at=None,display_description='',display_name='f2dc9c1c-e9a6-4b41-833b-ba4a6143a219-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce79331-c41f-427d-bab9-043b0ea46353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98d21bc4041b484e99e79e4968594156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:29:46Z,use_quota=True,user_id='4c453dd5e00b44b1ac4d34b54b3a8ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55061803-f88e-4426-88af-49f67bf237e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55061803-f88e-4426-88af-49f67bf237e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c43f53-39a5-484c-810e-750bce80dabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c43f53-39a5-484c-810e-750bce80dabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ce79331-c41f-427d-bab9-043b0ea46353', 'volume_name': 'volume-7ce79331-c41f-427d-bab9-043b0ea46353', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c88ba34-e581-416d-afc7-8a36cadf1c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c88ba34-e581-416d-afc7-8a36cadf1c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c876839-273a-4c02-9fc0-ca15e17d1f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:46 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Volume 7ce79331-c41f-427d-bab9-043b0ea46353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ce79331-c41f-427d-bab9-043b0ea46353', 'volume_size': 1} Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63070aa-abfe-4ba8-8640-dac6ff5515aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-773fcd1e-1df5-413e-8a9b-dc5ea63a8b13', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120335f6-e20f-42c6-861c-b458063d4c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:46 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Volume volume-773fcd1e-1df5-413e-8a9b-dc5ea63a8b13 (773fcd1e-1df5-413e-8a9b-dc5ea63a8b13): created successfully Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120335f6-e20f-42c6-861c-b458063d4c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Flow 'volume_create_manager' (8f3297b9-f722-4b22-b5b0-2b95a808cd2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:29:46 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-1b5a61ad-8b90-4a15-9d0b-da2a7fe33a83 tempest-AbsoluteLimitsTests-671412383 None] Created volume successfully. Feb 27 12:29:47 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-42817323-fd58-4906-83ff-aa06804b240a tempest-AbsoluteLimitsTests-671412383 None] Acquiring lock "cinder-773fcd1e-1df5-413e-8a9b-dc5ea63a8b13-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:29:48 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-42817323-fd58-4906-83ff-aa06804b240a tempest-AbsoluteLimitsTests-671412383 None] Lock "cinder-773fcd1e-1df5-413e-8a9b-dc5ea63a8b13-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:29:48 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-42817323-fd58-4906-83ff-aa06804b240a tempest-AbsoluteLimitsTests-671412383 None] Acquiring lock "cinder-quobyte-773fcd1e-1df5-413e-8a9b-dc5ea63a8b13" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:29:48 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-42817323-fd58-4906-83ff-aa06804b240a tempest-AbsoluteLimitsTests-671412383 None] Lock "cinder-quobyte-773fcd1e-1df5-413e-8a9b-dc5ea63a8b13" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:29:48 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[88111fbf-99f4-46be-8aa5-c55b74dc14f0]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:29:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-42817323-fd58-4906-83ff-aa06804b240a tempest-AbsoluteLimitsTests-671412383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-773fcd1e-1df5-413e-8a9b-dc5ea63a8b13 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:48 devstack sudo[85231]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4a734caf-48c4-41c5-ba70-67ad90bf504e 1073741824" returned: 0 in 1.629s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4a734caf-48c4-41c5-ba70-67ad90bf504e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:48 devstack sudo[85239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-773fcd1e-1df5-413e-8a9b-dc5ea63a8b13 Feb 27 12:29:48 devstack sudo[85239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:48 devstack sudo[85240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4a734caf-48c4-41c5-ba70-67ad90bf504e Feb 27 12:29:48 devstack sudo[85240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:49 devstack sudo[85240]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4a734caf-48c4-41c5-ba70-67ad90bf504e" returned: 0 in 0.872s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:49 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] <== create_volume: return (2584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:29:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.598s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.436s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:49 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:29:46Z,deleted=False,deleted_at=None,display_description='',display_name='f2dc9c1c-e9a6-4b41-833b-ba4a6143a219-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce79331-c41f-427d-bab9-043b0ea46353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98d21bc4041b484e99e79e4968594156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:29:46Z,use_quota=True,user_id='4c453dd5e00b44b1ac4d34b54b3a8ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:29:49 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Creating volume 7ce79331-c41f-427d-bab9-043b0ea46353 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:29:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:49 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:29:49 devstack sudo[85239]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:49 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:29:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:49 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:29:49 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:29:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7ce79331-c41f-427d-bab9-043b0ea46353 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-42817323-fd58-4906-83ff-aa06804b240a tempest-AbsoluteLimitsTests-671412383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-773fcd1e-1df5-413e-8a9b-dc5ea63a8b13" returned: 0 in 1.148s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-42817323-fd58-4906-83ff-aa06804b240a tempest-AbsoluteLimitsTests-671412383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-773fcd1e-1df5-413e-8a9b-dc5ea63a8b13 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:49 devstack sudo[85247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7ce79331-c41f-427d-bab9-043b0ea46353 1073741824 Feb 27 12:29:49 devstack sudo[85247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:49 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517ec9a0-d637-4a46-8db9-ecb1ba8070b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a734caf-48c4-41c5-ba70-67ad90bf504e', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:49 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83bfb779-5449-4c88-81f0-fd4d0a71c2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:49 devstack sudo[85248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-773fcd1e-1df5-413e-8a9b-dc5ea63a8b13 Feb 27 12:29:49 devstack sudo[85248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:49 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Volume volume-4a734caf-48c4-41c5-ba70-67ad90bf504e (4a734caf-48c4-41c5-ba70-67ad90bf504e): created successfully Feb 27 12:29:49 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83bfb779-5449-4c88-81f0-fd4d0a71c2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:49 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Flow 'volume_create_manager' (e4beefac-4ae0-45fa-ba5d-186562257008) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:29:49 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-80fd0e03-9938-405e-8bd0-b3604ea2be30 tempest-GroupsTest-2055894075 None] Created volume successfully. Feb 27 12:29:50 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-2106362d-cd6f-4e3d-94c1-bb40bc063a87 tempest-GroupsTest-2055894075 None] Acquiring lock "cinder-quobyte-4a734caf-48c4-41c5-ba70-67ad90bf504e" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:29:50 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-2106362d-cd6f-4e3d-94c1-bb40bc063a87 tempest-GroupsTest-2055894075 None] Lock "cinder-quobyte-4a734caf-48c4-41c5-ba70-67ad90bf504e" acquired by "delete_volume" :: waited 0.043s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:29:50 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6a68e5-f19a-4055-9e13-0806323f7b6e]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:29:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2106362d-cd6f-4e3d-94c1-bb40bc063a87 tempest-GroupsTest-2055894075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4a734caf-48c4-41c5-ba70-67ad90bf504e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:50 devstack sudo[85248]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-42817323-fd58-4906-83ff-aa06804b240a tempest-AbsoluteLimitsTests-671412383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-773fcd1e-1df5-413e-8a9b-dc5ea63a8b13" returned: 0 in 1.309s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:50 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-42817323-fd58-4906-83ff-aa06804b240a tempest-AbsoluteLimitsTests-671412383 None] Lock "cinder-quobyte-773fcd1e-1df5-413e-8a9b-dc5ea63a8b13" released by "delete_volume" :: held 2.541s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:29:50 devstack sudo[85254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4a734caf-48c4-41c5-ba70-67ad90bf504e Feb 27 12:29:50 devstack sudo[85254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:50 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-42817323-fd58-4906-83ff-aa06804b240a tempest-AbsoluteLimitsTests-671412383 None] Created reservations ['173f9056-6123-42ee-b663-f8a49d781869', 'a1ba3131-272d-4b3c-a21d-d0281a242f42', 'b8a1b052-de72-41e0-9501-7755d4c78c21', '26b48055-e404-4c34-b7be-5e936cb7b062'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:29:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-42817323-fd58-4906-83ff-aa06804b240a tempest-AbsoluteLimitsTests-671412383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-42817323-fd58-4906-83ff-aa06804b240a tempest-AbsoluteLimitsTests-671412383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:50 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-42817323-fd58-4906-83ff-aa06804b240a tempest-AbsoluteLimitsTests-671412383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:29:50 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-42817323-fd58-4906-83ff-aa06804b240a tempest-AbsoluteLimitsTests-671412383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:29:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-42817323-fd58-4906-83ff-aa06804b240a tempest-AbsoluteLimitsTests-671412383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-42817323-fd58-4906-83ff-aa06804b240a tempest-AbsoluteLimitsTests-671412383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:50 devstack sudo[85260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:29:50 devstack sudo[85260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:51 devstack sudo[85247]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7ce79331-c41f-427d-bab9-043b0ea46353 1073741824" returned: 0 in 2.167s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7ce79331-c41f-427d-bab9-043b0ea46353 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:51 devstack sudo[85277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7ce79331-c41f-427d-bab9-043b0ea46353 Feb 27 12:29:51 devstack sudo[85277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:51 devstack sudo[85260]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-42817323-fd58-4906-83ff-aa06804b240a tempest-AbsoluteLimitsTests-671412383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.874s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:51 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-42817323-fd58-4906-83ff-aa06804b240a tempest-AbsoluteLimitsTests-671412383 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:29:51 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-42817323-fd58-4906-83ff-aa06804b240a tempest-AbsoluteLimitsTests-671412383 None] Deleted volume successfully. Feb 27 12:29:51 devstack sudo[85254]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2106362d-cd6f-4e3d-94c1-bb40bc063a87 tempest-GroupsTest-2055894075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4a734caf-48c4-41c5-ba70-67ad90bf504e" returned: 0 in 1.170s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2106362d-cd6f-4e3d-94c1-bb40bc063a87 tempest-GroupsTest-2055894075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4a734caf-48c4-41c5-ba70-67ad90bf504e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:51 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-42817323-fd58-4906-83ff-aa06804b240a tempest-AbsoluteLimitsTests-671412383 None] Lock "cinder-773fcd1e-1df5-413e-8a9b-dc5ea63a8b13-delete_volume" released by "delete_volume" :: held 3.727s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:29:51 devstack sudo[85292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4a734caf-48c4-41c5-ba70-67ad90bf504e Feb 27 12:29:51 devstack sudo[85292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:52 devstack sudo[85292]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2106362d-cd6f-4e3d-94c1-bb40bc063a87 tempest-GroupsTest-2055894075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4a734caf-48c4-41c5-ba70-67ad90bf504e" returned: 0 in 1.159s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:52 devstack sudo[85277]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7ce79331-c41f-427d-bab9-043b0ea46353" returned: 0 in 1.446s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:52 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] <== create_volume: return (3673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:29:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.676s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:52 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-2106362d-cd6f-4e3d-94c1-bb40bc063a87 tempest-GroupsTest-2055894075 None] Lock "cinder-quobyte-4a734caf-48c4-41c5-ba70-67ad90bf504e" released by "delete_volume" :: held 2.476s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:29:52 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c876839-273a-4c02-9fc0-ca15e17d1f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ce79331-c41f-427d-bab9-043b0ea46353', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:52 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cedeb26a-8bc2-4718-a8f9-20a9deca3d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:52 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Volume volume-7ce79331-c41f-427d-bab9-043b0ea46353 (7ce79331-c41f-427d-bab9-043b0ea46353): created successfully Feb 27 12:29:52 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cedeb26a-8bc2-4718-a8f9-20a9deca3d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:52 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Flow 'volume_create_manager' (ea8b050c-b607-4642-9311-35db4fd1e75f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:29:53 devstack cinder-volume[83077]: INFO cinder.volume.manager [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-65454728-6c5f-4353-ba81-08fffa4e860c tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Created volume successfully. Feb 27 12:29:53 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-2106362d-cd6f-4e3d-94c1-bb40bc063a87 tempest-GroupsTest-2055894075 None] Created reservations ['6776199d-d8f3-4766-844b-3e8dc853dbf0'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:29:53 devstack cinder-volume[83077]: WARNING cinder.quota [None req-2106362d-cd6f-4e3d-94c1-bb40bc063a87 tempest-GroupsTest-2055894075 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-83266757 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-83266757, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:29:53 devstack cinder-volume[83077]: WARNING cinder.quota [None req-2106362d-cd6f-4e3d-94c1-bb40bc063a87 tempest-GroupsTest-2055894075 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-83266757 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-83266757, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:29:53 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-2106362d-cd6f-4e3d-94c1-bb40bc063a87 tempest-GroupsTest-2055894075 None] Created reservations ['9c0c1887-aba2-4808-af9b-4a87f3a8a365', 'ff743ac2-e318-49c0-abf0-36b82942dba1', '42b4e86b-b91a-409e-956d-4c6c5e015023', '97e7526e-7d5a-4341-8c12-a80568fe705a'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:29:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2106362d-cd6f-4e3d-94c1-bb40bc063a87 tempest-GroupsTest-2055894075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2106362d-cd6f-4e3d-94c1-bb40bc063a87 tempest-GroupsTest-2055894075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:53 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-2106362d-cd6f-4e3d-94c1-bb40bc063a87 tempest-GroupsTest-2055894075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:29:53 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-2106362d-cd6f-4e3d-94c1-bb40bc063a87 tempest-GroupsTest-2055894075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:29:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2106362d-cd6f-4e3d-94c1-bb40bc063a87 tempest-GroupsTest-2055894075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2106362d-cd6f-4e3d-94c1-bb40bc063a87 tempest-GroupsTest-2055894075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:53 devstack sudo[85344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:29:53 devstack sudo[85344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:53 devstack sudo[85344]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2106362d-cd6f-4e3d-94c1-bb40bc063a87 tempest-GroupsTest-2055894075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.706s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:53 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-2106362d-cd6f-4e3d-94c1-bb40bc063a87 tempest-GroupsTest-2055894075 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:29:53 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-2106362d-cd6f-4e3d-94c1-bb40bc063a87 tempest-GroupsTest-2055894075 None] Delete group completed successfully. Feb 27 12:29:54 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-58adb025-b424-4b93-ab10-d7d06dbf2c08 tempest-GroupsTest-2055894075 None] Created reservations ['9960555f-ccb3-4b3e-ae86-c694f27ca209'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:29:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-58adb025-b424-4b93-ab10-d7d06dbf2c08 tempest-GroupsTest-2055894075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-58adb025-b424-4b93-ab10-d7d06dbf2c08 tempest-GroupsTest-2055894075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:54 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-58adb025-b424-4b93-ab10-d7d06dbf2c08 tempest-GroupsTest-2055894075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:29:54 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-58adb025-b424-4b93-ab10-d7d06dbf2c08 tempest-GroupsTest-2055894075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:29:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-58adb025-b424-4b93-ab10-d7d06dbf2c08 tempest-GroupsTest-2055894075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-58adb025-b424-4b93-ab10-d7d06dbf2c08 tempest-GroupsTest-2055894075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:54 devstack sudo[85349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:29:54 devstack sudo[85349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:54 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a4161dbc-03e2-47e9-b938-6126a9a33b17 tempest-ServerRescueNegativeTestJSON-712914185 None] Acquiring lock "cinder-fff4faff-61e1-4bdf-b381-e077f1a2dc8b-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:29:54 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a4161dbc-03e2-47e9-b938-6126a9a33b17 tempest-ServerRescueNegativeTestJSON-712914185 None] Lock "cinder-fff4faff-61e1-4bdf-b381-e077f1a2dc8b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:29:54 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a4161dbc-03e2-47e9-b938-6126a9a33b17 tempest-ServerRescueNegativeTestJSON-712914185 None] Acquiring lock "cinder-quobyte-fff4faff-61e1-4bdf-b381-e077f1a2dc8b" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:29:54 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a4161dbc-03e2-47e9-b938-6126a9a33b17 tempest-ServerRescueNegativeTestJSON-712914185 None] Lock "cinder-quobyte-fff4faff-61e1-4bdf-b381-e077f1a2dc8b" acquired by "delete_volume" :: waited 0.016s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:29:54 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2e4bfa-d0a4-4ab2-a45a-3763fb8b2f33]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:29:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a4161dbc-03e2-47e9-b938-6126a9a33b17 tempest-ServerRescueNegativeTestJSON-712914185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fff4faff-61e1-4bdf-b381-e077f1a2dc8b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:54 devstack sudo[85351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fff4faff-61e1-4bdf-b381-e077f1a2dc8b Feb 27 12:29:54 devstack sudo[85351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:55 devstack sudo[85349]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-58adb025-b424-4b93-ab10-d7d06dbf2c08 tempest-GroupsTest-2055894075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 1.056s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:55 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-58adb025-b424-4b93-ab10-d7d06dbf2c08 tempest-GroupsTest-2055894075 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:29:55 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-58adb025-b424-4b93-ab10-d7d06dbf2c08 tempest-GroupsTest-2055894075 None] Delete group completed successfully. Feb 27 12:29:55 devstack sudo[85351]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a4161dbc-03e2-47e9-b938-6126a9a33b17 tempest-ServerRescueNegativeTestJSON-712914185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fff4faff-61e1-4bdf-b381-e077f1a2dc8b" returned: 0 in 1.052s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a4161dbc-03e2-47e9-b938-6126a9a33b17 tempest-ServerRescueNegativeTestJSON-712914185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fff4faff-61e1-4bdf-b381-e077f1a2dc8b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:55 devstack sudo[85358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fff4faff-61e1-4bdf-b381-e077f1a2dc8b Feb 27 12:29:55 devstack sudo[85358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:56 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-84576558-632b-400c-80eb-f11a73d6ccc3 tempest-GroupsTest-2055894075 None] Group tempest-GroupsTest-Group-506207771: creating Feb 27 12:29:56 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-84576558-632b-400c-80eb-f11a73d6ccc3 tempest-GroupsTest-2055894075 None] Group tempest-GroupsTest-Group-506207771: created successfully Feb 27 12:29:56 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-84576558-632b-400c-80eb-f11a73d6ccc3 tempest-GroupsTest-2055894075 None] Create group completed successfully. Feb 27 12:29:56 devstack sudo[85358]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a4161dbc-03e2-47e9-b938-6126a9a33b17 tempest-ServerRescueNegativeTestJSON-712914185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fff4faff-61e1-4bdf-b381-e077f1a2dc8b" returned: 0 in 0.531s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:56 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a4161dbc-03e2-47e9-b938-6126a9a33b17 tempest-ServerRescueNegativeTestJSON-712914185 None] Lock "cinder-quobyte-fff4faff-61e1-4bdf-b381-e077f1a2dc8b" released by "delete_volume" :: held 1.700s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:29:56 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-a4161dbc-03e2-47e9-b938-6126a9a33b17 tempest-ServerRescueNegativeTestJSON-712914185 None] Created reservations ['4714f97a-1f83-4ef9-910b-f8c84632d174', '432de8ac-a33b-4480-858b-8613a3596bcb', '387280f8-5f66-420b-a5a4-230677c2ac16', '19c3b560-b723-4c19-9078-c72e071b9789'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:29:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a4161dbc-03e2-47e9-b938-6126a9a33b17 tempest-ServerRescueNegativeTestJSON-712914185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a4161dbc-03e2-47e9-b938-6126a9a33b17 tempest-ServerRescueNegativeTestJSON-712914185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:56 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a4161dbc-03e2-47e9-b938-6126a9a33b17 tempest-ServerRescueNegativeTestJSON-712914185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:29:56 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a4161dbc-03e2-47e9-b938-6126a9a33b17 tempest-ServerRescueNegativeTestJSON-712914185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:29:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a4161dbc-03e2-47e9-b938-6126a9a33b17 tempest-ServerRescueNegativeTestJSON-712914185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a4161dbc-03e2-47e9-b938-6126a9a33b17 tempest-ServerRescueNegativeTestJSON-712914185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:56 devstack sudo[85369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:29:56 devstack sudo[85369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-a4ac7693-20bd-475c-9122-4652094db4f1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-a4ac7693-20bd-475c-9122-4652094db4f1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:56 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfb98b8-a082-42e1-98dd-e43fe5212d6b]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:29:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-a4ac7693-20bd-475c-9122-4652094db4f1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7ce79331-c41f-427d-bab9-043b0ea46353 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:56 devstack sudo[85371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7ce79331-c41f-427d-bab9-043b0ea46353 Feb 27 12:29:56 devstack sudo[85371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:57 devstack sudo[85369]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a4161dbc-03e2-47e9-b938-6126a9a33b17 tempest-ServerRescueNegativeTestJSON-712914185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 1.201s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:57 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-a4161dbc-03e2-47e9-b938-6126a9a33b17 tempest-ServerRescueNegativeTestJSON-712914185 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:29:57 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-a4161dbc-03e2-47e9-b938-6126a9a33b17 tempest-ServerRescueNegativeTestJSON-712914185 None] Deleted volume successfully. Feb 27 12:29:57 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a4161dbc-03e2-47e9-b938-6126a9a33b17 tempest-ServerRescueNegativeTestJSON-712914185 None] Lock "cinder-fff4faff-61e1-4bdf-b381-e077f1a2dc8b-delete_volume" released by "delete_volume" :: held 3.190s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:29:57 devstack sudo[85371]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-a4ac7693-20bd-475c-9122-4652094db4f1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7ce79331-c41f-427d-bab9-043b0ea46353" returned: 0 in 1.132s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-a4ac7693-20bd-475c-9122-4652094db4f1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.163s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-a4ac7693-20bd-475c-9122-4652094db4f1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84', 'name': 'volume-7ce79331-c41f-427d-bab9-043b0ea46353', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77423115-48ae-43f2-8bc6-d5c2a2506d32', 'enforce_multipath': True} {{(pid=83077) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 27 12:29:57 devstack cinder-volume[83077]: INFO cinder.volume.manager [req-c9111ea1-d1e6-4ca3-862d-c07b9815ac1d req-a4ac7693-20bd-475c-9122-4652094db4f1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] attachment_update completed successfully. Feb 27 12:29:57 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:29:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Flow 'volume_create_manager' (9a80bb43-92f8-44e5-be59-8d3f8f2ed68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:29:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e8e133-a882-4cd9-a901-e40f53030570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e8e133-a882-4cd9-a901-e40f53030570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-3931258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11552c94-fb4b-4496-9b97-cd0829352276,host='devstack@QuobyteHD#QuobyteHD',id=b12aaa82-1ba0-42c9-a39c-726ab53c0317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb574aaad53e43e9856fac15f69ed04e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:29:58Z,use_quota=True,user_id='fff0588b781f42ab8fd6195cc7f9f9af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a9d821e-56a0-4ae1-b9c6-cba6b3913c56),volume_type_id=9a9d821e-56a0-4ae1-b9c6-cba6b3913c56)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c8c969-2bc8-4f5f-acf9-23d096f8dca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c8c969-2bc8-4f5f-acf9-23d096f8dca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c082a8c1-73db-4b3f-88d8-6b74a8f829d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c082a8c1-73db-4b3f-88d8-6b74a8f829d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b12aaa82-1ba0-42c9-a39c-726ab53c0317', 'volume_name': 'volume-b12aaa82-1ba0-42c9-a39c-726ab53c0317', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc8df7aa-3f1a-4554-9674-92bfd7b9d6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc8df7aa-3f1a-4554-9674-92bfd7b9d6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ec9766-15cf-4a48-87e3-c8a299698f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:58 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Volume b12aaa82-1ba0-42c9-a39c-726ab53c0317: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b12aaa82-1ba0-42c9-a39c-726ab53c0317', 'volume_size': 1} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=11552c94-fb4b-4496-9b97-cd0829352276,created_at=2026-02-27T11:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-3931258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11552c94-fb4b-4496-9b97-cd0829352276,host='devstack@QuobyteHD#QuobyteHD',id=b12aaa82-1ba0-42c9-a39c-726ab53c0317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb574aaad53e43e9856fac15f69ed04e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:29:58Z,use_quota=True,user_id='fff0588b781f42ab8fd6195cc7f9f9af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a9d821e-56a0-4ae1-b9c6-cba6b3913c56),volume_type_id=9a9d821e-56a0-4ae1-b9c6-cba6b3913c56)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Creating volume b12aaa82-1ba0-42c9-a39c-726ab53c0317 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:29:58 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b12aaa82-1ba0-42c9-a39c-726ab53c0317 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:58 devstack sudo[85377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b12aaa82-1ba0-42c9-a39c-726ab53c0317 1073741824 Feb 27 12:29:58 devstack sudo[85377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG oslo_service.periodic_task [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83077) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:58 devstack sudo[85407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:29:58 devstack sudo[85407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Flow 'volume_create_manager' (e5bb2ec9-23bf-44e5-88f1-bb647ddcf301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e34a6ec-9110-4c88-85c8-5300e0e7e7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e34a6ec-9110-4c88-85c8-5300e0e7e7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1048405079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd8e61d4-1bc8-4cad-ba86-3e037923a452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3507c6c1bf4683aa728e02d76a8df7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:29:59Z,use_quota=True,user_id='baadc18f05734fe384679b20871d8894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dcf7c7d-bc58-4f52-ac96-05b9f2d4814e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dcf7c7d-bc58-4f52-ac96-05b9f2d4814e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (168fa816-5d5a-40f0-8550-6251b8abf360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (168fa816-5d5a-40f0-8550-6251b8abf360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd8e61d4-1bc8-4cad-ba86-3e037923a452', 'volume_name': 'volume-bd8e61d4-1bc8-4cad-ba86-3e037923a452', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f901542a-3e10-4d74-834b-44ffe2374e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f901542a-3e10-4d74-834b-44ffe2374e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012413b5-6a8e-4e91-934d-9fb1c59c29c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:58 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Volume bd8e61d4-1bc8-4cad-ba86-3e037923a452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd8e61d4-1bc8-4cad-ba86-3e037923a452', 'volume_size': 1} Feb 27 12:29:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:59 devstack sudo[85407]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.740s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:59 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:29:59 devstack sudo[85377]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b12aaa82-1ba0-42c9-a39c-726ab53c0317 1073741824" returned: 0 in 1.268s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b12aaa82-1ba0-42c9-a39c-726ab53c0317 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:59 devstack sudo[85414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b12aaa82-1ba0-42c9-a39c-726ab53c0317 Feb 27 12:29:59 devstack sudo[85414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:59 devstack sudo[85414]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b12aaa82-1ba0-42c9-a39c-726ab53c0317" returned: 0 in 0.587s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:59 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] <== create_volume: return (1909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:29:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.912s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.035s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:59 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1048405079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd8e61d4-1bc8-4cad-ba86-3e037923a452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3507c6c1bf4683aa728e02d76a8df7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:29:59Z,use_quota=True,user_id='baadc18f05734fe384679b20871d8894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:29:59 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Creating volume bd8e61d4-1bc8-4cad-ba86-3e037923a452 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:30:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:00 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:00 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:00 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:30:00 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:30:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-bd8e61d4-1bc8-4cad-ba86-3e037923a452 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:00 devstack sudo[85440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-bd8e61d4-1bc8-4cad-ba86-3e037923a452 1073741824 Feb 27 12:30:00 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ec9766-15cf-4a48-87e3-c8a299698f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b12aaa82-1ba0-42c9-a39c-726ab53c0317', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:00 devstack sudo[85440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:00 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c135f26f-b3bd-47af-8315-c9c329c54be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:00 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Volume volume-b12aaa82-1ba0-42c9-a39c-726ab53c0317 (b12aaa82-1ba0-42c9-a39c-726ab53c0317): created successfully Feb 27 12:30:00 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c135f26f-b3bd-47af-8315-c9c329c54be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:00 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Flow 'volume_create_manager' (9a80bb43-92f8-44e5-be59-8d3f8f2ed68b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:00 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-2dec1774-dd46-44cb-80ff-16a5a4814514 tempest-GroupsTest-2055894075 None] Created volume successfully. Feb 27 12:30:00 devstack sudo[85440]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-bd8e61d4-1bc8-4cad-ba86-3e037923a452 1073741824" returned: 0 in 0.627s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-bd8e61d4-1bc8-4cad-ba86-3e037923a452 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:00 devstack sudo[85489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-bd8e61d4-1bc8-4cad-ba86-3e037923a452 Feb 27 12:30:00 devstack sudo[85489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:00 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:30:00 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Flow 'volume_create_manager' (921d23f5-e5d5-43e7-92ac-bebf45b15464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:00 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b18365-969c-495f-8f85-d277312e49d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:00 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b18365-969c-495f-8f85-d277312e49d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-117919196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11552c94-fb4b-4496-9b97-cd0829352276,host='devstack@QuobyteHD#QuobyteHD',id=4eaf50bb-3a63-4d31-8163-d7195810cab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb574aaad53e43e9856fac15f69ed04e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:01Z,use_quota=True,user_id='fff0588b781f42ab8fd6195cc7f9f9af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a9d821e-56a0-4ae1-b9c6-cba6b3913c56),volume_type_id=9a9d821e-56a0-4ae1-b9c6-cba6b3913c56)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:00 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d98aa1-dda1-4834-bf86-5e93cc7711c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:00 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d98aa1-dda1-4834-bf86-5e93cc7711c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:00 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdcc5c26-d9ff-4691-86a2-415a6d177d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:00 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdcc5c26-d9ff-4691-86a2-415a6d177d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4eaf50bb-3a63-4d31-8163-d7195810cab0', 'volume_name': 'volume-4eaf50bb-3a63-4d31-8163-d7195810cab0', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:00 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a85ed17-2a64-4ef3-8e6a-8d8368a8f205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:00 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a85ed17-2a64-4ef3-8e6a-8d8368a8f205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:00 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c0b23dc-20a5-45f3-a00a-6b5e3115ddc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:00 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Volume 4eaf50bb-3a63-4d31-8163-d7195810cab0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4eaf50bb-3a63-4d31-8163-d7195810cab0', 'volume_size': 1} Feb 27 12:30:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:01 devstack sudo[85489]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-bd8e61d4-1bc8-4cad-ba86-3e037923a452" returned: 0 in 0.584s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:01 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:30:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.339s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:01 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=11552c94-fb4b-4496-9b97-cd0829352276,created_at=2026-02-27T11:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-117919196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11552c94-fb4b-4496-9b97-cd0829352276,host='devstack@QuobyteHD#QuobyteHD',id=4eaf50bb-3a63-4d31-8163-d7195810cab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb574aaad53e43e9856fac15f69ed04e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:01Z,use_quota=True,user_id='fff0588b781f42ab8fd6195cc7f9f9af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a9d821e-56a0-4ae1-b9c6-cba6b3913c56),volume_type_id=9a9d821e-56a0-4ae1-b9c6-cba6b3913c56)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:30:01 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Creating volume 4eaf50bb-3a63-4d31-8163-d7195810cab0 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:30:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:01 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:01 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:01 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:30:01 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:30:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4eaf50bb-3a63-4d31-8163-d7195810cab0 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:01 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012413b5-6a8e-4e91-934d-9fb1c59c29c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd8e61d4-1bc8-4cad-ba86-3e037923a452', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:01 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9648e7d4-8efb-487b-82d4-1699e7dad1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:01 devstack sudo[85496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4eaf50bb-3a63-4d31-8163-d7195810cab0 1073741824 Feb 27 12:30:01 devstack sudo[85496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:01 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Volume volume-bd8e61d4-1bc8-4cad-ba86-3e037923a452 (bd8e61d4-1bc8-4cad-ba86-3e037923a452): created successfully Feb 27 12:30:01 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9648e7d4-8efb-487b-82d4-1699e7dad1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:01 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Flow 'volume_create_manager' (e5bb2ec9-23bf-44e5-88f1-bb647ddcf301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:01 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-f423512e-a855-40f4-be31-f2aa59b3f02d tempest-VolumesMetadataTest-1036221164 None] Created volume successfully. Feb 27 12:30:01 devstack sudo[85496]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4eaf50bb-3a63-4d31-8163-d7195810cab0 1073741824" returned: 0 in 0.647s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4eaf50bb-3a63-4d31-8163-d7195810cab0 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:02 devstack sudo[85501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4eaf50bb-3a63-4d31-8163-d7195810cab0 Feb 27 12:30:02 devstack sudo[85501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:02 devstack sudo[85501]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4eaf50bb-3a63-4d31-8163-d7195810cab0" returned: 0 in 0.981s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:02 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:30:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c0b23dc-20a5-45f3-a00a-6b5e3115ddc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eaf50bb-3a63-4d31-8163-d7195810cab0', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e5d050-99e7-4424-896e-2229060312dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:03 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Volume volume-4eaf50bb-3a63-4d31-8163-d7195810cab0 (4eaf50bb-3a63-4d31-8163-d7195810cab0): created successfully Feb 27 12:30:03 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e5d050-99e7-4424-896e-2229060312dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:03 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Flow 'volume_create_manager' (921d23f5-e5d5-43e7-92ac-bebf45b15464) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:03 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-d3b57b41-6cdb-486a-9a79-124bd82956a6 tempest-GroupsTest-2055894075 None] Created volume successfully. Feb 27 12:30:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-36849f7b-e12e-43b2-99a4-1a09c5e16c4d tempest-VolumesMetadataTest-1036221164 None] Acquiring lock "cinder-bd8e61d4-1bc8-4cad-ba86-3e037923a452-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-36849f7b-e12e-43b2-99a4-1a09c5e16c4d tempest-VolumesMetadataTest-1036221164 None] Lock "cinder-bd8e61d4-1bc8-4cad-ba86-3e037923a452-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-36849f7b-e12e-43b2-99a4-1a09c5e16c4d tempest-VolumesMetadataTest-1036221164 None] Acquiring lock "cinder-quobyte-bd8e61d4-1bc8-4cad-ba86-3e037923a452" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-36849f7b-e12e-43b2-99a4-1a09c5e16c4d tempest-VolumesMetadataTest-1036221164 None] Lock "cinder-quobyte-bd8e61d4-1bc8-4cad-ba86-3e037923a452" acquired by "delete_volume" :: waited 0.019s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:03 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35fb683-25ce-4805-8657-efcd89726c7e]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-36849f7b-e12e-43b2-99a4-1a09c5e16c4d tempest-VolumesMetadataTest-1036221164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-bd8e61d4-1bc8-4cad-ba86-3e037923a452 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:03 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-54ae81bc-61fb-42d5-acce-2cc25efd7b85 tempest-GroupsTest-2055894075 None] Update group completed successfully. Feb 27 12:30:03 devstack sudo[85841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-bd8e61d4-1bc8-4cad-ba86-3e037923a452 Feb 27 12:30:03 devstack sudo[85841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:03 devstack sudo[85841]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-36849f7b-e12e-43b2-99a4-1a09c5e16c4d tempest-VolumesMetadataTest-1036221164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-bd8e61d4-1bc8-4cad-ba86-3e037923a452" returned: 0 in 0.730s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-36849f7b-e12e-43b2-99a4-1a09c5e16c4d tempest-VolumesMetadataTest-1036221164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-bd8e61d4-1bc8-4cad-ba86-3e037923a452 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:03 devstack sudo[85847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-bd8e61d4-1bc8-4cad-ba86-3e037923a452 Feb 27 12:30:03 devstack sudo[85847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:04 devstack sudo[85847]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-36849f7b-e12e-43b2-99a4-1a09c5e16c4d tempest-VolumesMetadataTest-1036221164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-bd8e61d4-1bc8-4cad-ba86-3e037923a452" returned: 0 in 0.516s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-36849f7b-e12e-43b2-99a4-1a09c5e16c4d tempest-VolumesMetadataTest-1036221164 None] Lock "cinder-quobyte-bd8e61d4-1bc8-4cad-ba86-3e037923a452" released by "delete_volume" :: held 1.301s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:04 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-36849f7b-e12e-43b2-99a4-1a09c5e16c4d tempest-VolumesMetadataTest-1036221164 None] Created reservations ['02feba92-9f5d-46b3-86f6-82e3d41db277', '9eead59b-29b9-4583-b219-09c06ce80d65', '348bd8b1-d791-47d8-ac8c-9b4d68cdda72', '2d684a78-1498-4cec-9a1b-c211f8b644b7'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-36849f7b-e12e-43b2-99a4-1a09c5e16c4d tempest-VolumesMetadataTest-1036221164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-36849f7b-e12e-43b2-99a4-1a09c5e16c4d tempest-VolumesMetadataTest-1036221164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-36849f7b-e12e-43b2-99a4-1a09c5e16c4d tempest-VolumesMetadataTest-1036221164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-36849f7b-e12e-43b2-99a4-1a09c5e16c4d tempest-VolumesMetadataTest-1036221164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-36849f7b-e12e-43b2-99a4-1a09c5e16c4d tempest-VolumesMetadataTest-1036221164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-36849f7b-e12e-43b2-99a4-1a09c5e16c4d tempest-VolumesMetadataTest-1036221164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:04 devstack sudo[85850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:30:04 devstack sudo[85850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:04 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-df1d3919-0f5e-4e8d-abe8-efef6ef38372 tempest-GroupsTest-2055894075 None] Update group completed successfully. Feb 27 12:30:05 devstack sudo[85850]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-36849f7b-e12e-43b2-99a4-1a09c5e16c4d tempest-VolumesMetadataTest-1036221164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.496s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:05 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-36849f7b-e12e-43b2-99a4-1a09c5e16c4d tempest-VolumesMetadataTest-1036221164 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:30:05 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-36849f7b-e12e-43b2-99a4-1a09c5e16c4d tempest-VolumesMetadataTest-1036221164 None] Deleted volume successfully. Feb 27 12:30:05 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-36849f7b-e12e-43b2-99a4-1a09c5e16c4d tempest-VolumesMetadataTest-1036221164 None] Lock "cinder-bd8e61d4-1bc8-4cad-ba86-3e037923a452-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:06 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] Acquiring lock "cinder-quobyte-4eaf50bb-3a63-4d31-8163-d7195810cab0" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:06 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] Lock "cinder-quobyte-4eaf50bb-3a63-4d31-8163-d7195810cab0" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:06 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[6910fcdc-eff2-40b0-aeb8-f707882ac309]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4eaf50bb-3a63-4d31-8163-d7195810cab0 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:06 devstack sudo[85874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4eaf50bb-3a63-4d31-8163-d7195810cab0 Feb 27 12:30:06 devstack sudo[85874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:06 devstack sudo[85874]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4eaf50bb-3a63-4d31-8163-d7195810cab0" returned: 0 in 0.585s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4eaf50bb-3a63-4d31-8163-d7195810cab0 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:06 devstack sudo[85879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4eaf50bb-3a63-4d31-8163-d7195810cab0 Feb 27 12:30:06 devstack sudo[85879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:07 devstack sudo[85879]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4eaf50bb-3a63-4d31-8163-d7195810cab0" returned: 0 in 0.513s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] Lock "cinder-quobyte-4eaf50bb-3a63-4d31-8163-d7195810cab0" released by "delete_volume" :: held 1.135s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] Acquiring lock "cinder-quobyte-b12aaa82-1ba0-42c9-a39c-726ab53c0317" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] Lock "cinder-quobyte-b12aaa82-1ba0-42c9-a39c-726ab53c0317" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a5cc03-8d0a-44d4-aceb-dec172acac6b]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b12aaa82-1ba0-42c9-a39c-726ab53c0317 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:07 devstack sudo[85882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b12aaa82-1ba0-42c9-a39c-726ab53c0317 Feb 27 12:30:07 devstack sudo[85882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Flow 'volume_create_manager' (28b19b9a-62a0-463b-b968-b9c6be67c71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e580e6-54b5-44ae-be91-7c6508914058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e580e6-54b5-44ae-be91-7c6508914058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2054724064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5609a3e1-e2f4-4f97-a9d0-cec2409dbc63,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3a24b96422d04c0bb25ffec0aeaf383a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:07Z,use_quota=True,user_id='58c8462104e24f1c8e066a09d244fa34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95476a03-7723-40af-83ab-9b0bf2897649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95476a03-7723-40af-83ab-9b0bf2897649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624350e1-aa36-440e-a290-a0b50e42e775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624350e1-aa36-440e-a290-a0b50e42e775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5609a3e1-e2f4-4f97-a9d0-cec2409dbc63', 'volume_name': 'volume-5609a3e1-e2f4-4f97-a9d0-cec2409dbc63', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72e2e7a-6531-4685-956c-66110cb1b1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72e2e7a-6531-4685-956c-66110cb1b1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72edffeb-cc3f-47e9-a7ad-e016a04a7a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:07 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Volume 5609a3e1-e2f4-4f97-a9d0-cec2409dbc63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5609a3e1-e2f4-4f97-a9d0-cec2409dbc63', 'volume_size': 1} Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2054724064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5609a3e1-e2f4-4f97-a9d0-cec2409dbc63,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3a24b96422d04c0bb25ffec0aeaf383a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:07Z,use_quota=True,user_id='58c8462104e24f1c8e066a09d244fa34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Creating volume 5609a3e1-e2f4-4f97-a9d0-cec2409dbc63 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:30:07 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5609a3e1-e2f4-4f97-a9d0-cec2409dbc63 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:07 devstack sudo[85885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5609a3e1-e2f4-4f97-a9d0-cec2409dbc63 1073741824 Feb 27 12:30:07 devstack sudo[85885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:07 devstack sudo[85882]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b12aaa82-1ba0-42c9-a39c-726ab53c0317" returned: 0 in 0.537s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b12aaa82-1ba0-42c9-a39c-726ab53c0317 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:07 devstack sudo[85890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b12aaa82-1ba0-42c9-a39c-726ab53c0317 Feb 27 12:30:07 devstack sudo[85890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:08 devstack sudo[85885]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5609a3e1-e2f4-4f97-a9d0-cec2409dbc63 1073741824" returned: 0 in 0.549s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5609a3e1-e2f4-4f97-a9d0-cec2409dbc63 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:08 devstack sudo[85895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5609a3e1-e2f4-4f97-a9d0-cec2409dbc63 Feb 27 12:30:08 devstack sudo[85895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:08 devstack sudo[85890]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b12aaa82-1ba0-42c9-a39c-726ab53c0317" returned: 0 in 0.469s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:08 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] Lock "cinder-quobyte-b12aaa82-1ba0-42c9-a39c-726ab53c0317" released by "delete_volume" :: held 1.039s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:08 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] Created reservations ['092b5683-0e3b-494a-86fc-baeb9b824b5b'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:08 devstack cinder-volume[83077]: WARNING cinder.quota [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1779772201 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1779772201, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:30:08 devstack cinder-volume[83077]: WARNING cinder.quota [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1779772201 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1779772201, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:30:08 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] Created reservations ['e7679310-0efb-4fe8-9bc4-390991fd37c4', '1fc8250f-db70-432d-a237-3aced7873aa3', '5fc13771-a9e5-4db8-abd5-786552f1fb17', 'ae80672f-40e3-4995-921f-f37c5ada32de'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:08 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] Created reservations ['6328f1c0-da0e-403f-a459-b5a89bcaa3f9', '5911e6d1-23d5-4a11-a32b-3019efb72ba9', 'd77764bb-d718-49f9-8e4b-b7ea56056344', '65920b92-ca83-43f3-b577-90544e7e2467'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:08 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:08 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:08 devstack sudo[85898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:30:08 devstack sudo[85898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:08 devstack sudo[85895]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5609a3e1-e2f4-4f97-a9d0-cec2409dbc63" returned: 0 in 0.476s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:08 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:30:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:08 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72edffeb-cc3f-47e9-a7ad-e016a04a7a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5609a3e1-e2f4-4f97-a9d0-cec2409dbc63', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:08 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91954180-0a3f-4fae-8546-fd5da46e2649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:08 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Volume volume-5609a3e1-e2f4-4f97-a9d0-cec2409dbc63 (5609a3e1-e2f4-4f97-a9d0-cec2409dbc63): created successfully Feb 27 12:30:08 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91954180-0a3f-4fae-8546-fd5da46e2649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:08 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Flow 'volume_create_manager' (28b19b9a-62a0-463b-b968-b9c6be67c71e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:08 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-8e60f574-aaf8-44ed-96df-1135df643768 tempest-VolumesListTestJSON-631719916 None] Created volume successfully. Feb 27 12:30:08 devstack sudo[85898]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.403s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:08 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:30:08 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-db799155-c7d1-45de-b6c2-d9281613c58e tempest-GroupsTest-2055894075 None] Delete group completed successfully. Feb 27 12:30:09 devstack cinder-volume[83077]: DEBUG dbcounter [-] [83077] Writing DB stats cinder:SELECT=144,cinder:INSERT=32,cinder:UPDATE=164,cinder:DELETE=3 {{(pid=83077) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:30:09 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:30:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Flow 'volume_create_manager' (880154fb-2d3a-406c-b154-d433792a60f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (206ad581-a087-4647-8cfc-6311a88b697e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (206ad581-a087-4647-8cfc-6311a88b697e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1331792623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9565f95d-b8a6-4e47-b5ed-c24cdb52a342,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3a24b96422d04c0bb25ffec0aeaf383a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:10Z,use_quota=True,user_id='58c8462104e24f1c8e066a09d244fa34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e40e9bc-e3b2-4ba2-a342-373b7d3e02ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e40e9bc-e3b2-4ba2-a342-373b7d3e02ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ee7d88-0105-4c7c-93f5-15e8f0c04a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ee7d88-0105-4c7c-93f5-15e8f0c04a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9565f95d-b8a6-4e47-b5ed-c24cdb52a342', 'volume_name': 'volume-9565f95d-b8a6-4e47-b5ed-c24cdb52a342', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8266d43-0820-442e-b1ed-eb2ae502badc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8266d43-0820-442e-b1ed-eb2ae502badc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edcae988-a169-4c43-8bd9-f0781b98bc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:09 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Volume 9565f95d-b8a6-4e47-b5ed-c24cdb52a342: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9565f95d-b8a6-4e47-b5ed-c24cdb52a342', 'volume_size': 1} Feb 27 12:30:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:09 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1331792623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9565f95d-b8a6-4e47-b5ed-c24cdb52a342,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3a24b96422d04c0bb25ffec0aeaf383a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:10Z,use_quota=True,user_id='58c8462104e24f1c8e066a09d244fa34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:30:09 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Creating volume 9565f95d-b8a6-4e47-b5ed-c24cdb52a342 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:30:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:09 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:09 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:09 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:30:09 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:30:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9565f95d-b8a6-4e47-b5ed-c24cdb52a342 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:09 devstack sudo[85902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9565f95d-b8a6-4e47-b5ed-c24cdb52a342 1073741824 Feb 27 12:30:09 devstack sudo[85902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:10 devstack sudo[85902]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9565f95d-b8a6-4e47-b5ed-c24cdb52a342 1073741824" returned: 0 in 0.748s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9565f95d-b8a6-4e47-b5ed-c24cdb52a342 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:10 devstack sudo[85928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9565f95d-b8a6-4e47-b5ed-c24cdb52a342 Feb 27 12:30:10 devstack sudo[85928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:11 devstack sudo[85928]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9565f95d-b8a6-4e47-b5ed-c24cdb52a342" returned: 0 in 0.526s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:11 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:30:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:11 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edcae988-a169-4c43-8bd9-f0781b98bc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9565f95d-b8a6-4e47-b5ed-c24cdb52a342', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:11 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b18fb71e-232a-4d61-8063-ec3690728383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:11 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Volume volume-9565f95d-b8a6-4e47-b5ed-c24cdb52a342 (9565f95d-b8a6-4e47-b5ed-c24cdb52a342): created successfully Feb 27 12:30:11 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b18fb71e-232a-4d61-8063-ec3690728383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:11 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Flow 'volume_create_manager' (880154fb-2d3a-406c-b154-d433792a60f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:11 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-381da0e5-d919-4707-a948-00742c4322e7 tempest-VolumesListTestJSON-631719916 None] Created volume successfully. Feb 27 12:30:12 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:30:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Flow 'volume_create_manager' (b9e3c1e5-12f6-49f2-aa1c-a282a34abdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d745fbb8-edb1-4f35-8cdb-1ff9109bb2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d745fbb8-edb1-4f35-8cdb-1ff9109bb2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1978780608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5790f3a-fc47-412e-ab63-9a1966888380,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3a24b96422d04c0bb25ffec0aeaf383a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:12Z,use_quota=True,user_id='58c8462104e24f1c8e066a09d244fa34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22bafa30-10ac-4a96-bba5-bd38c98bf4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22bafa30-10ac-4a96-bba5-bd38c98bf4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41026e78-d951-4a05-95bd-2e911c3f44f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41026e78-d951-4a05-95bd-2e911c3f44f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5790f3a-fc47-412e-ab63-9a1966888380', 'volume_name': 'volume-b5790f3a-fc47-412e-ab63-9a1966888380', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (753d826d-8ccf-47da-980b-c31fc4fdff59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (753d826d-8ccf-47da-980b-c31fc4fdff59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f46bba-1014-40cb-a3c1-1b068ab649ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:12 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Volume b5790f3a-fc47-412e-ab63-9a1966888380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5790f3a-fc47-412e-ab63-9a1966888380', 'volume_size': 1} Feb 27 12:30:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:12 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1978780608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5790f3a-fc47-412e-ab63-9a1966888380,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3a24b96422d04c0bb25ffec0aeaf383a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:12Z,use_quota=True,user_id='58c8462104e24f1c8e066a09d244fa34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:30:12 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Creating volume b5790f3a-fc47-412e-ab63-9a1966888380 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:30:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:12 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:12 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:12 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:30:12 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:30:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b5790f3a-fc47-412e-ab63-9a1966888380 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:12 devstack sudo[85953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b5790f3a-fc47-412e-ab63-9a1966888380 1073741824 Feb 27 12:30:12 devstack sudo[85953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:13 devstack sudo[85953]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b5790f3a-fc47-412e-ab63-9a1966888380 1073741824" returned: 0 in 0.612s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b5790f3a-fc47-412e-ab63-9a1966888380 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:13 devstack sudo[85959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b5790f3a-fc47-412e-ab63-9a1966888380 Feb 27 12:30:13 devstack sudo[85959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:13 devstack sudo[85959]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b5790f3a-fc47-412e-ab63-9a1966888380" returned: 0 in 0.519s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:13 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:30:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f46bba-1014-40cb-a3c1-1b068ab649ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5790f3a-fc47-412e-ab63-9a1966888380', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c82bcc83-7463-481a-bfa4-3331fe482f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:13 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Volume volume-b5790f3a-fc47-412e-ab63-9a1966888380 (b5790f3a-fc47-412e-ab63-9a1966888380): created successfully Feb 27 12:30:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c82bcc83-7463-481a-bfa4-3331fe482f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Flow 'volume_create_manager' (b9e3c1e5-12f6-49f2-aa1c-a282a34abdd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:13 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-463ded68-8981-4117-83f0-73802bc3e1b5 tempest-VolumesListTestJSON-631719916 None] Created volume successfully. Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-43c7f879-f6ee-4ae8-899b-2de38a79d7b4 tempest-VolumesListTestJSON-631719916 None] Acquiring lock "cinder-b5790f3a-fc47-412e-ab63-9a1966888380-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-43c7f879-f6ee-4ae8-899b-2de38a79d7b4 tempest-VolumesListTestJSON-631719916 None] Lock "cinder-b5790f3a-fc47-412e-ab63-9a1966888380-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG dbcounter [-] [83077] Writing DB stats cinder:UPDATE=114,cinder:DELETE=12,cinder:SELECT=95,cinder:INSERT=29 {{(pid=83077) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-43c7f879-f6ee-4ae8-899b-2de38a79d7b4 tempest-VolumesListTestJSON-631719916 None] Acquiring lock "cinder-quobyte-b5790f3a-fc47-412e-ab63-9a1966888380" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-43c7f879-f6ee-4ae8-899b-2de38a79d7b4 tempest-VolumesListTestJSON-631719916 None] Lock "cinder-quobyte-b5790f3a-fc47-412e-ab63-9a1966888380" acquired by "delete_volume" :: waited 0.034s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[4189cff6-cada-455b-b2bc-6df2a4190a10]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-43c7f879-f6ee-4ae8-899b-2de38a79d7b4 tempest-VolumesListTestJSON-631719916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b5790f3a-fc47-412e-ab63-9a1966888380 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Flow 'volume_create_manager' (7bea12d5-11f6-4f3f-a1a1-e3c062c4fa0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc57f4bf-4af9-4f86-b086-eb8eb581d0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:17 devstack sudo[85990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b5790f3a-fc47-412e-ab63-9a1966888380 Feb 27 12:30:17 devstack sudo[85990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc57f4bf-4af9-4f86-b086-eb8eb581d0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1641459385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='40484cabd6ff4dc9b9c3d7df35b1bcf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:17Z,use_quota=True,user_id='cbd3174ff3dd47029e8da3520ff8f5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9252283-2477-4030-ade6-0ac07810886a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9252283-2477-4030-ade6-0ac07810886a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa045c7-d6e4-4f39-a7e5-02b3af667f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa045c7-d6e4-4f39-a7e5-02b3af667f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd', 'volume_name': 'volume-f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47cc2396-5bb6-499f-b5a9-dd6a594f122d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47cc2396-5bb6-499f-b5a9-dd6a594f122d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a34fcbe-03b8-4ed6-aafd-2ca79a9d832e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:17 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Volume f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd', 'volume_size': 1} Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1641459385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='40484cabd6ff4dc9b9c3d7df35b1bcf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:17Z,use_quota=True,user_id='cbd3174ff3dd47029e8da3520ff8f5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Creating volume f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:30:17 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:30:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:17 devstack sudo[85993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd 1073741824 Feb 27 12:30:17 devstack sudo[85993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:18 devstack sudo[85990]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-43c7f879-f6ee-4ae8-899b-2de38a79d7b4 tempest-VolumesListTestJSON-631719916 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b5790f3a-fc47-412e-ab63-9a1966888380" returned: 0 in 0.773s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-43c7f879-f6ee-4ae8-899b-2de38a79d7b4 tempest-VolumesListTestJSON-631719916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b5790f3a-fc47-412e-ab63-9a1966888380 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:18 devstack sudo[86001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b5790f3a-fc47-412e-ab63-9a1966888380 Feb 27 12:30:18 devstack sudo[86001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:18 devstack sudo[85993]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd 1073741824" returned: 0 in 0.666s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:18 devstack sudo[86003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd Feb 27 12:30:18 devstack sudo[86003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:18 devstack sudo[86001]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-43c7f879-f6ee-4ae8-899b-2de38a79d7b4 tempest-VolumesListTestJSON-631719916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b5790f3a-fc47-412e-ab63-9a1966888380" returned: 0 in 0.624s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:18 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-43c7f879-f6ee-4ae8-899b-2de38a79d7b4 tempest-VolumesListTestJSON-631719916 None] Lock "cinder-quobyte-b5790f3a-fc47-412e-ab63-9a1966888380" released by "delete_volume" :: held 1.480s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:18 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-43c7f879-f6ee-4ae8-899b-2de38a79d7b4 tempest-VolumesListTestJSON-631719916 None] Created reservations ['8b463e03-fd56-42f4-ae03-a467c9da7feb', 'dbe7bd8a-6dc3-4d22-be6e-ec2550bd2b3a', '2280f1e1-a1b3-4aef-a34a-04e49fa40a84', 'fb26b85f-1b28-4bad-8cf0-bdefadfd5ade'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-43c7f879-f6ee-4ae8-899b-2de38a79d7b4 tempest-VolumesListTestJSON-631719916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-43c7f879-f6ee-4ae8-899b-2de38a79d7b4 tempest-VolumesListTestJSON-631719916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:18 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-43c7f879-f6ee-4ae8-899b-2de38a79d7b4 tempest-VolumesListTestJSON-631719916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:18 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-43c7f879-f6ee-4ae8-899b-2de38a79d7b4 tempest-VolumesListTestJSON-631719916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-43c7f879-f6ee-4ae8-899b-2de38a79d7b4 tempest-VolumesListTestJSON-631719916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-43c7f879-f6ee-4ae8-899b-2de38a79d7b4 tempest-VolumesListTestJSON-631719916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:18 devstack sudo[86006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:30:18 devstack sudo[86006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:19 devstack sudo[86003]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd" returned: 0 in 0.704s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:30:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a34fcbe-03b8-4ed6-aafd-2ca79a9d832e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04456a3e-2725-4335-acfb-ef999d31a2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:19 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Volume volume-f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd (f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd): created successfully Feb 27 12:30:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04456a3e-2725-4335-acfb-ef999d31a2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Flow 'volume_create_manager' (7bea12d5-11f6-4f3f-a1a1-e3c062c4fa0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:19 devstack cinder-volume[83077]: INFO cinder.volume.manager [req-5ef678fd-94ce-4cfc-848d-a6705c5e1d08 req-1e2dbf59-23f3-4266-acaa-8f3fe1280420 tempest-VolumesGetTestJSON-370636815 None] Created volume successfully. Feb 27 12:30:19 devstack sudo[86006]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-43c7f879-f6ee-4ae8-899b-2de38a79d7b4 tempest-VolumesListTestJSON-631719916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.407s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:19 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-43c7f879-f6ee-4ae8-899b-2de38a79d7b4 tempest-VolumesListTestJSON-631719916 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:30:19 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-43c7f879-f6ee-4ae8-899b-2de38a79d7b4 tempest-VolumesListTestJSON-631719916 None] Deleted volume successfully. Feb 27 12:30:19 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-43c7f879-f6ee-4ae8-899b-2de38a79d7b4 tempest-VolumesListTestJSON-631719916 None] Lock "cinder-b5790f3a-fc47-412e-ab63-9a1966888380-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:19 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f86d74f3-aa9d-432a-b8f7-e7e48834a25f tempest-VolumesListTestJSON-631719916 None] Acquiring lock "cinder-9565f95d-b8a6-4e47-b5ed-c24cdb52a342-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:19 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f86d74f3-aa9d-432a-b8f7-e7e48834a25f tempest-VolumesListTestJSON-631719916 None] Lock "cinder-9565f95d-b8a6-4e47-b5ed-c24cdb52a342-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:19 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f86d74f3-aa9d-432a-b8f7-e7e48834a25f tempest-VolumesListTestJSON-631719916 None] Acquiring lock "cinder-quobyte-9565f95d-b8a6-4e47-b5ed-c24cdb52a342" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:19 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f86d74f3-aa9d-432a-b8f7-e7e48834a25f tempest-VolumesListTestJSON-631719916 None] Lock "cinder-quobyte-9565f95d-b8a6-4e47-b5ed-c24cdb52a342" acquired by "delete_volume" :: waited 0.007s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:19 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[81790054-945c-4ec2-8612-8209151e2df7]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f86d74f3-aa9d-432a-b8f7-e7e48834a25f tempest-VolumesListTestJSON-631719916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9565f95d-b8a6-4e47-b5ed-c24cdb52a342 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:19 devstack sudo[86010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9565f95d-b8a6-4e47-b5ed-c24cdb52a342 Feb 27 12:30:19 devstack sudo[86010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:20 devstack sudo[86010]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f86d74f3-aa9d-432a-b8f7-e7e48834a25f tempest-VolumesListTestJSON-631719916 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9565f95d-b8a6-4e47-b5ed-c24cdb52a342" returned: 0 in 0.694s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f86d74f3-aa9d-432a-b8f7-e7e48834a25f tempest-VolumesListTestJSON-631719916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9565f95d-b8a6-4e47-b5ed-c24cdb52a342 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:20 devstack sudo[86039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9565f95d-b8a6-4e47-b5ed-c24cdb52a342 Feb 27 12:30:20 devstack sudo[86039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:20 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-8021f30d-0c80-400a-9353-35ffa88764b2 req-2727a35e-d167-4fda-b56a-26abfea76e7f tempest-VolumesGetTestJSON-370636815 None] Acquiring lock "cinder-f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:20 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-8021f30d-0c80-400a-9353-35ffa88764b2 req-2727a35e-d167-4fda-b56a-26abfea76e7f tempest-VolumesGetTestJSON-370636815 None] Lock "cinder-f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:20 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-8021f30d-0c80-400a-9353-35ffa88764b2 req-2727a35e-d167-4fda-b56a-26abfea76e7f tempest-VolumesGetTestJSON-370636815 None] Acquiring lock "cinder-quobyte-f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:20 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-8021f30d-0c80-400a-9353-35ffa88764b2 req-2727a35e-d167-4fda-b56a-26abfea76e7f tempest-VolumesGetTestJSON-370636815 None] Lock "cinder-quobyte-f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd" acquired by "delete_volume" :: waited 0.017s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:20 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d1d196-cb26-4f4c-b397-1e3ebfc78ed2]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-8021f30d-0c80-400a-9353-35ffa88764b2 req-2727a35e-d167-4fda-b56a-26abfea76e7f tempest-VolumesGetTestJSON-370636815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:20 devstack sudo[86041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd Feb 27 12:30:20 devstack sudo[86041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:20 devstack sudo[86039]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f86d74f3-aa9d-432a-b8f7-e7e48834a25f tempest-VolumesListTestJSON-631719916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9565f95d-b8a6-4e47-b5ed-c24cdb52a342" returned: 0 in 0.545s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:20 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f86d74f3-aa9d-432a-b8f7-e7e48834a25f tempest-VolumesListTestJSON-631719916 None] Lock "cinder-quobyte-9565f95d-b8a6-4e47-b5ed-c24cdb52a342" released by "delete_volume" :: held 1.279s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:20 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-f86d74f3-aa9d-432a-b8f7-e7e48834a25f tempest-VolumesListTestJSON-631719916 None] Created reservations ['58ad6ddb-a80c-4524-a406-cb40b637b180', '1b4b8eb1-5c10-4a79-9e4a-5f109dd49916', '01e175b2-3b59-41b1-a4f1-7ff88e22e80e', 'ad7c5cd3-c6fa-424d-8ea9-d0f1ef70fb73'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f86d74f3-aa9d-432a-b8f7-e7e48834a25f tempest-VolumesListTestJSON-631719916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f86d74f3-aa9d-432a-b8f7-e7e48834a25f tempest-VolumesListTestJSON-631719916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:20 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f86d74f3-aa9d-432a-b8f7-e7e48834a25f tempest-VolumesListTestJSON-631719916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:20 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f86d74f3-aa9d-432a-b8f7-e7e48834a25f tempest-VolumesListTestJSON-631719916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f86d74f3-aa9d-432a-b8f7-e7e48834a25f tempest-VolumesListTestJSON-631719916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f86d74f3-aa9d-432a-b8f7-e7e48834a25f tempest-VolumesListTestJSON-631719916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:20 devstack sudo[86045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:30:20 devstack sudo[86045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:21 devstack sudo[86041]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-8021f30d-0c80-400a-9353-35ffa88764b2 req-2727a35e-d167-4fda-b56a-26abfea76e7f tempest-VolumesGetTestJSON-370636815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd" returned: 0 in 0.600s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-8021f30d-0c80-400a-9353-35ffa88764b2 req-2727a35e-d167-4fda-b56a-26abfea76e7f tempest-VolumesGetTestJSON-370636815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:21 devstack sudo[86050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd Feb 27 12:30:21 devstack sudo[86050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:21 devstack sudo[86045]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f86d74f3-aa9d-432a-b8f7-e7e48834a25f tempest-VolumesListTestJSON-631719916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.446s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:21 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-f86d74f3-aa9d-432a-b8f7-e7e48834a25f tempest-VolumesListTestJSON-631719916 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:30:21 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-f86d74f3-aa9d-432a-b8f7-e7e48834a25f tempest-VolumesListTestJSON-631719916 None] Deleted volume successfully. Feb 27 12:30:21 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f86d74f3-aa9d-432a-b8f7-e7e48834a25f tempest-VolumesListTestJSON-631719916 None] Lock "cinder-9565f95d-b8a6-4e47-b5ed-c24cdb52a342-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:21 devstack sudo[86050]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-8021f30d-0c80-400a-9353-35ffa88764b2 req-2727a35e-d167-4fda-b56a-26abfea76e7f tempest-VolumesGetTestJSON-370636815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd" returned: 0 in 0.465s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:21 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-8021f30d-0c80-400a-9353-35ffa88764b2 req-2727a35e-d167-4fda-b56a-26abfea76e7f tempest-VolumesGetTestJSON-370636815 None] Lock "cinder-quobyte-f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd" released by "delete_volume" :: held 1.133s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:21 devstack cinder-volume[83077]: DEBUG cinder.quota [req-8021f30d-0c80-400a-9353-35ffa88764b2 req-2727a35e-d167-4fda-b56a-26abfea76e7f tempest-VolumesGetTestJSON-370636815 None] Created reservations ['764981a3-5100-4e06-8419-049799bab07d', '2911ee75-e358-4bc0-8f86-e2b6956c4155', 'f163941b-4fa5-4b74-93b9-cd14d4aa5d7a', '1842dc57-3ba6-4d71-99c9-b8fcb1794a50'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-8021f30d-0c80-400a-9353-35ffa88764b2 req-2727a35e-d167-4fda-b56a-26abfea76e7f tempest-VolumesGetTestJSON-370636815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-8021f30d-0c80-400a-9353-35ffa88764b2 req-2727a35e-d167-4fda-b56a-26abfea76e7f tempest-VolumesGetTestJSON-370636815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:21 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-8021f30d-0c80-400a-9353-35ffa88764b2 req-2727a35e-d167-4fda-b56a-26abfea76e7f tempest-VolumesGetTestJSON-370636815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:21 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-8021f30d-0c80-400a-9353-35ffa88764b2 req-2727a35e-d167-4fda-b56a-26abfea76e7f tempest-VolumesGetTestJSON-370636815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-8021f30d-0c80-400a-9353-35ffa88764b2 req-2727a35e-d167-4fda-b56a-26abfea76e7f tempest-VolumesGetTestJSON-370636815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-8021f30d-0c80-400a-9353-35ffa88764b2 req-2727a35e-d167-4fda-b56a-26abfea76e7f tempest-VolumesGetTestJSON-370636815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:21 devstack sudo[86077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:30:21 devstack sudo[86077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:21 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7eeb261c-d72f-4e98-97e1-9c3103845811 tempest-VolumesListTestJSON-631719916 None] Acquiring lock "cinder-5609a3e1-e2f4-4f97-a9d0-cec2409dbc63-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:21 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7eeb261c-d72f-4e98-97e1-9c3103845811 tempest-VolumesListTestJSON-631719916 None] Lock "cinder-5609a3e1-e2f4-4f97-a9d0-cec2409dbc63-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:21 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7eeb261c-d72f-4e98-97e1-9c3103845811 tempest-VolumesListTestJSON-631719916 None] Acquiring lock "cinder-quobyte-5609a3e1-e2f4-4f97-a9d0-cec2409dbc63" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:21 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7eeb261c-d72f-4e98-97e1-9c3103845811 tempest-VolumesListTestJSON-631719916 None] Lock "cinder-quobyte-5609a3e1-e2f4-4f97-a9d0-cec2409dbc63" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:21 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[52641242-98c8-43d0-9c0b-de30025cc6e3]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7eeb261c-d72f-4e98-97e1-9c3103845811 tempest-VolumesListTestJSON-631719916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5609a3e1-e2f4-4f97-a9d0-cec2409dbc63 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:22 devstack sudo[86080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5609a3e1-e2f4-4f97-a9d0-cec2409dbc63 Feb 27 12:30:22 devstack sudo[86080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:22 devstack sudo[86077]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-8021f30d-0c80-400a-9353-35ffa88764b2 req-2727a35e-d167-4fda-b56a-26abfea76e7f tempest-VolumesGetTestJSON-370636815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.531s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:22 devstack cinder-volume[83077]: DEBUG cinder.manager [req-8021f30d-0c80-400a-9353-35ffa88764b2 req-2727a35e-d167-4fda-b56a-26abfea76e7f tempest-VolumesGetTestJSON-370636815 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:30:22 devstack cinder-volume[83077]: INFO cinder.volume.manager [req-8021f30d-0c80-400a-9353-35ffa88764b2 req-2727a35e-d167-4fda-b56a-26abfea76e7f tempest-VolumesGetTestJSON-370636815 None] Deleted volume successfully. Feb 27 12:30:22 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-8021f30d-0c80-400a-9353-35ffa88764b2 req-2727a35e-d167-4fda-b56a-26abfea76e7f tempest-VolumesGetTestJSON-370636815 None] Lock "cinder-f54bee6d-3bfe-4823-86f1-c4a75e4cf8bd-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:22 devstack sudo[86080]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7eeb261c-d72f-4e98-97e1-9c3103845811 tempest-VolumesListTestJSON-631719916 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5609a3e1-e2f4-4f97-a9d0-cec2409dbc63" returned: 0 in 0.654s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7eeb261c-d72f-4e98-97e1-9c3103845811 tempest-VolumesListTestJSON-631719916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5609a3e1-e2f4-4f97-a9d0-cec2409dbc63 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:22 devstack sudo[86108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5609a3e1-e2f4-4f97-a9d0-cec2409dbc63 Feb 27 12:30:22 devstack sudo[86108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:23 devstack sudo[86108]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7eeb261c-d72f-4e98-97e1-9c3103845811 tempest-VolumesListTestJSON-631719916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5609a3e1-e2f4-4f97-a9d0-cec2409dbc63" returned: 0 in 0.631s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:23 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7eeb261c-d72f-4e98-97e1-9c3103845811 tempest-VolumesListTestJSON-631719916 None] Lock "cinder-quobyte-5609a3e1-e2f4-4f97-a9d0-cec2409dbc63" released by "delete_volume" :: held 1.310s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:23 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-7eeb261c-d72f-4e98-97e1-9c3103845811 tempest-VolumesListTestJSON-631719916 None] Created reservations ['0724a73a-7168-49d9-90a1-800349f4fc5b', 'f3e74840-d543-4155-b29b-2d414432ba7e', '882dd836-192d-4978-8678-fa91209f78bc', '9f2f287c-27ae-4837-8e2e-f442c586422b'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7eeb261c-d72f-4e98-97e1-9c3103845811 tempest-VolumesListTestJSON-631719916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7eeb261c-d72f-4e98-97e1-9c3103845811 tempest-VolumesListTestJSON-631719916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:23 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7eeb261c-d72f-4e98-97e1-9c3103845811 tempest-VolumesListTestJSON-631719916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:23 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7eeb261c-d72f-4e98-97e1-9c3103845811 tempest-VolumesListTestJSON-631719916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7eeb261c-d72f-4e98-97e1-9c3103845811 tempest-VolumesListTestJSON-631719916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7eeb261c-d72f-4e98-97e1-9c3103845811 tempest-VolumesListTestJSON-631719916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:23 devstack sudo[86112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:30:23 devstack sudo[86112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:23 devstack sudo[86112]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7eeb261c-d72f-4e98-97e1-9c3103845811 tempest-VolumesListTestJSON-631719916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.494s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:23 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-7eeb261c-d72f-4e98-97e1-9c3103845811 tempest-VolumesListTestJSON-631719916 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:30:23 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-7eeb261c-d72f-4e98-97e1-9c3103845811 tempest-VolumesListTestJSON-631719916 None] Deleted volume successfully. Feb 27 12:30:23 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7eeb261c-d72f-4e98-97e1-9c3103845811 tempest-VolumesListTestJSON-631719916 None] Lock "cinder-5609a3e1-e2f4-4f97-a9d0-cec2409dbc63-delete_volume" released by "delete_volume" :: held 1.974s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:26 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:30:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Flow 'volume_create_manager' (88525f3d-4154-49d8-97d9-708aab8ddd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762c6765-f060-4983-952d-f5f7b6ba1544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762c6765-f060-4983-952d-f5f7b6ba1544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-985268628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f67406-a5db-4446-a1f6-919436b2057b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7d08e50b16a4ed4bd390a066557104d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:26Z,use_quota=True,user_id='024112e6fd77428fb07585935d5cf834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (972a6164-b980-4a0a-9d05-964536fa9c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (972a6164-b980-4a0a-9d05-964536fa9c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3703ee6b-445d-4de6-87e8-7bb838d5e90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3703ee6b-445d-4de6-87e8-7bb838d5e90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43f67406-a5db-4446-a1f6-919436b2057b', 'volume_name': 'volume-43f67406-a5db-4446-a1f6-919436b2057b', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43030d08-b22d-4f92-b46d-274cfcd179ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43030d08-b22d-4f92-b46d-274cfcd179ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed794fd-2a2a-4ada-a500-10419ca0a6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:26 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Volume 43f67406-a5db-4446-a1f6-919436b2057b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43f67406-a5db-4446-a1f6-919436b2057b', 'volume_size': 1} Feb 27 12:30:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-985268628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f67406-a5db-4446-a1f6-919436b2057b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7d08e50b16a4ed4bd390a066557104d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:26Z,use_quota=True,user_id='024112e6fd77428fb07585935d5cf834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:30:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Creating volume 43f67406-a5db-4446-a1f6-919436b2057b {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:30:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:30:26 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:30:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:26 devstack sudo[86166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b 1073741824 Feb 27 12:30:26 devstack sudo[86166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:27 devstack sudo[86166]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b 1073741824" returned: 0 in 0.614s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:27 devstack sudo[86171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b Feb 27 12:30:27 devstack sudo[86171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:27 devstack sudo[86171]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b" returned: 0 in 0.445s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:30:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:27 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed794fd-2a2a-4ada-a500-10419ca0a6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43f67406-a5db-4446-a1f6-919436b2057b', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:27 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fda450b-61b7-42fa-94b4-b7e565e78d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:27 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Volume volume-43f67406-a5db-4446-a1f6-919436b2057b (43f67406-a5db-4446-a1f6-919436b2057b): created successfully Feb 27 12:30:27 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fda450b-61b7-42fa-94b4-b7e565e78d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:27 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Flow 'volume_create_manager' (88525f3d-4154-49d8-97d9-708aab8ddd3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:27 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-120fa8b6-5754-4a79-a52c-5d5ed73f9ad7 tempest-SnapshotsActionsTest-949698680 None] Created volume successfully. Feb 27 12:30:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-603b1efd-5ef5-420d-9a3c-186742e209d0 tempest-SnapshotsActionsTest-949698680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-603b1efd-5ef5-420d-9a3c-186742e209d0 tempest-SnapshotsActionsTest-949698680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:28 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-603b1efd-5ef5-420d-9a3c-186742e209d0 tempest-SnapshotsActionsTest-949698680 None] Creating offline snapshot 69485911-ec8c-468c-a6d2-9500123458f1 of volume 43f67406-a5db-4446-a1f6-919436b2057b {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:30:28 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df0ba4e-0191-409e-bda0-e334a297c060]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-603b1efd-5ef5-420d-9a3c-186742e209d0 tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:28 devstack sudo[86174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b Feb 27 12:30:28 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:29 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-603b1efd-5ef5-420d-9a3c-186742e209d0 tempest-SnapshotsActionsTest-949698680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b" returned: 0 in 0.601s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-603b1efd-5ef5-420d-9a3c-186742e209d0 tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:29 devstack sudo[86179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 1G Feb 27 12:30:29 devstack sudo[86179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:29 devstack sudo[86179]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-603b1efd-5ef5-420d-9a3c-186742e209d0 tempest-SnapshotsActionsTest-949698680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 1G" returned: 0 in 0.607s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-603b1efd-5ef5-420d-9a3c-186742e209d0 tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f67406-a5db-4446-a1f6-919436b2057b -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:29 devstack sudo[86184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f67406-a5db-4446-a1f6-919436b2057b -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 Feb 27 12:30:29 devstack sudo[86184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:30 devstack sudo[86184]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-603b1efd-5ef5-420d-9a3c-186742e209d0 tempest-SnapshotsActionsTest-949698680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f67406-a5db-4446-a1f6-919436b2057b -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1" returned: 0 in 0.506s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:30 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-603b1efd-5ef5-420d-9a3c-186742e209d0 tempest-SnapshotsActionsTest-949698680 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 is being set with open permissions: ugo+rw Feb 27 12:30:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-603b1efd-5ef5-420d-9a3c-186742e209d0 tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:30 devstack sudo[86189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 Feb 27 12:30:30 devstack sudo[86189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:31 devstack sudo[86189]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-603b1efd-5ef5-420d-9a3c-186742e209d0 tempest-SnapshotsActionsTest-949698680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1" returned: 0 in 0.676s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-603b1efd-5ef5-420d-9a3c-186742e209d0 tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:31 devstack sudo[86193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.info Feb 27 12:30:31 devstack sudo[86193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:31 devstack sudo[86193]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-603b1efd-5ef5-420d-9a3c-186742e209d0 tempest-SnapshotsActionsTest-949698680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.info" returned: 0 in 0.506s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:31 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-603b1efd-5ef5-420d-9a3c-186742e209d0 tempest-SnapshotsActionsTest-949698680 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.info is being set with open permissions: ugo+rw Feb 27 12:30:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-603b1efd-5ef5-420d-9a3c-186742e209d0 tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:31 devstack sudo[86196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.info Feb 27 12:30:31 devstack sudo[86196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:32 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:30:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Flow 'volume_create_manager' (2d61ea41-ebc2-4b1c-8619-380728dc8289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e43a808-3c29-4838-8b00-3bc7cf1e1174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e43a808-3c29-4838-8b00-3bc7cf1e1174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-737540427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dd812c4-6093-4529-8881-586c4b08ee68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d72a51c30b2411b8bc9ee378b120aee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:32Z,use_quota=True,user_id='ecd82a660493409b99a294c09faafbb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f58f23-a62c-4012-83db-6d59c0c87d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f58f23-a62c-4012-83db-6d59c0c87d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d4a768-cbf1-4892-b865-de68c5f87cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d4a768-cbf1-4892-b865-de68c5f87cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dd812c4-6093-4529-8881-586c4b08ee68', 'volume_name': 'volume-1dd812c4-6093-4529-8881-586c4b08ee68', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d68568-86a8-4cfa-9361-c7c2ffc609d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d68568-86a8-4cfa-9361-c7c2ffc609d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b251188-9e07-48e3-ad37-a0ff122da24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:32 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Volume 1dd812c4-6093-4529-8881-586c4b08ee68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dd812c4-6093-4529-8881-586c4b08ee68', 'volume_size': 1} Feb 27 12:30:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:32 devstack sudo[86196]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-603b1efd-5ef5-420d-9a3c-186742e209d0 tempest-SnapshotsActionsTest-949698680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.info" returned: 0 in 0.603s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-603b1efd-5ef5-420d-9a3c-186742e209d0 tempest-SnapshotsActionsTest-949698680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.571s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.055s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:32 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-737540427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dd812c4-6093-4529-8881-586c4b08ee68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d72a51c30b2411b8bc9ee378b120aee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:32Z,use_quota=True,user_id='ecd82a660493409b99a294c09faafbb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:30:32 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Creating volume 1dd812c4-6093-4529-8881-586c4b08ee68 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:30:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:32 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:32 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:32 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:30:32 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:30:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dd812c4-6093-4529-8881-586c4b08ee68 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:32 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-603b1efd-5ef5-420d-9a3c-186742e209d0 tempest-SnapshotsActionsTest-949698680 None] Create snapshot completed successfully Feb 27 12:30:32 devstack sudo[86201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dd812c4-6093-4529-8881-586c4b08ee68 1073741824 Feb 27 12:30:32 devstack sudo[86201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:32 devstack sudo[86201]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dd812c4-6093-4529-8881-586c4b08ee68 1073741824" returned: 0 in 0.584s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dd812c4-6093-4529-8881-586c4b08ee68 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:32 devstack sudo[86220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dd812c4-6093-4529-8881-586c4b08ee68 Feb 27 12:30:32 devstack sudo[86220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1b838f5e-1f80-4bcd-be12-555becdc3c81 tempest-SnapshotsActionsTest-949698680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:33 devstack sudo[86220]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dd812c4-6093-4529-8881-586c4b08ee68" returned: 0 in 0.515s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:33 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:30:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1b838f5e-1f80-4bcd-be12-555becdc3c81 tempest-SnapshotsActionsTest-949698680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.086s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:33 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b251188-9e07-48e3-ad37-a0ff122da24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dd812c4-6093-4529-8881-586c4b08ee68', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:33 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d200234a-77d0-4665-8611-4588590128f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:33 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-1b838f5e-1f80-4bcd-be12-555becdc3c81 tempest-SnapshotsActionsTest-949698680 None] Creating offline snapshot a08bc242-b03a-4536-a224-c02e88b67c3e of volume 43f67406-a5db-4446-a1f6-919436b2057b {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:30:33 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Volume volume-1dd812c4-6093-4529-8881-586c4b08ee68 (1dd812c4-6093-4529-8881-586c4b08ee68): created successfully Feb 27 12:30:33 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d200234a-77d0-4665-8611-4588590128f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:33 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Flow 'volume_create_manager' (2d61ea41-ebc2-4b1c-8619-380728dc8289) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:33 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6f7fb5-d0d3-4054-a633-754e5fac5506]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1b838f5e-1f80-4bcd-be12-555becdc3c81 tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:33 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-c98fab52-2868-4677-8e48-0b4b2a1b95c7 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Created volume successfully. Feb 27 12:30:33 devstack sudo[86225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 Feb 27 12:30:33 devstack sudo[86225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:33 devstack sudo[86225]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1b838f5e-1f80-4bcd-be12-555becdc3c81 tempest-SnapshotsActionsTest-949698680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1" returned: 0 in 0.494s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:33 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-1b838f5e-1f80-4bcd-be12-555becdc3c81 tempest-SnapshotsActionsTest-949698680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f67406-a5db-4446-a1f6-919436b2057b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:30:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1b838f5e-1f80-4bcd-be12-555becdc3c81 tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.a08bc242-b03a-4536-a224-c02e88b67c3e 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:34 devstack sudo[86230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.a08bc242-b03a-4536-a224-c02e88b67c3e 1G Feb 27 12:30:34 devstack sudo[86230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:34 devstack sudo[86230]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1b838f5e-1f80-4bcd-be12-555becdc3c81 tempest-SnapshotsActionsTest-949698680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.a08bc242-b03a-4536-a224-c02e88b67c3e 1G" returned: 0 in 0.655s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1b838f5e-1f80-4bcd-be12-555becdc3c81 tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.a08bc242-b03a-4536-a224-c02e88b67c3e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:34 devstack sudo[86235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.a08bc242-b03a-4536-a224-c02e88b67c3e Feb 27 12:30:34 devstack sudo[86235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:34 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-359a246f-577b-42b1-9e1f-8c870de50a97 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Acquiring lock "cinder-1dd812c4-6093-4529-8881-586c4b08ee68-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:34 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-359a246f-577b-42b1-9e1f-8c870de50a97 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Lock "cinder-1dd812c4-6093-4529-8881-586c4b08ee68-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:34 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-359a246f-577b-42b1-9e1f-8c870de50a97 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Acquiring lock "cinder-quobyte-1dd812c4-6093-4529-8881-586c4b08ee68" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:34 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-359a246f-577b-42b1-9e1f-8c870de50a97 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Lock "cinder-quobyte-1dd812c4-6093-4529-8881-586c4b08ee68" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:34 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd24a433-0195-4980-8368-94e1f7a48ef3]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-359a246f-577b-42b1-9e1f-8c870de50a97 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dd812c4-6093-4529-8881-586c4b08ee68 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:35 devstack sudo[86237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dd812c4-6093-4529-8881-586c4b08ee68 Feb 27 12:30:35 devstack sudo[86237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1b838f5e-1f80-4bcd-be12-555becdc3c81 tempest-SnapshotsActionsTest-949698680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.a08bc242-b03a-4536-a224-c02e88b67c3e" returned: 0 in 0.542s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:35 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-1b838f5e-1f80-4bcd-be12-555becdc3c81 tempest-SnapshotsActionsTest-949698680 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.a08bc242-b03a-4536-a224-c02e88b67c3e is being set with open permissions: ugo+rw Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1b838f5e-1f80-4bcd-be12-555becdc3c81 tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.a08bc242-b03a-4536-a224-c02e88b67c3e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:35 devstack sudo[86235]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:35 devstack sudo[86242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.a08bc242-b03a-4536-a224-c02e88b67c3e Feb 27 12:30:35 devstack sudo[86242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:35 devstack sudo[86237]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-359a246f-577b-42b1-9e1f-8c870de50a97 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dd812c4-6093-4529-8881-586c4b08ee68" returned: 0 in 0.571s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-359a246f-577b-42b1-9e1f-8c870de50a97 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dd812c4-6093-4529-8881-586c4b08ee68 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:35 devstack sudo[86250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dd812c4-6093-4529-8881-586c4b08ee68 Feb 27 12:30:35 devstack sudo[86250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Flow 'volume_create_manager' (44acd761-ce60-46d8-ab6a-91db40d7cbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edfc040a-5147-483f-81dc-72f5c8c28945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edfc040a-5147-483f-81dc-72f5c8c28945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-297535290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782fb295-f88d-4f75-9a68-36912c536a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9efd9d3f52184a73bc3e993f4def7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:36Z,use_quota=True,user_id='5100277d035744ff9ac8e7e06d4abd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (116fd07a-5583-488c-ba8d-91334d497425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (116fd07a-5583-488c-ba8d-91334d497425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ab1bf8-182b-42b3-b590-bae055fbd8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ab1bf8-182b-42b3-b590-bae055fbd8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '782fb295-f88d-4f75-9a68-36912c536a5d', 'volume_name': 'volume-782fb295-f88d-4f75-9a68-36912c536a5d', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81856831-81a3-4462-a738-f38ddea97057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81856831-81a3-4462-a738-f38ddea97057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a25ea7-bc19-48a4-b441-4a91df0cf0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:35 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Volume 782fb295-f88d-4f75-9a68-36912c536a5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-782fb295-f88d-4f75-9a68-36912c536a5d', 'volume_size': 1} Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:35 devstack sudo[86242]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1b838f5e-1f80-4bcd-be12-555becdc3c81 tempest-SnapshotsActionsTest-949698680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.a08bc242-b03a-4536-a224-c02e88b67c3e" returned: 0 in 0.435s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1b838f5e-1f80-4bcd-be12-555becdc3c81 tempest-SnapshotsActionsTest-949698680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.203s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.042s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-297535290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782fb295-f88d-4f75-9a68-36912c536a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9efd9d3f52184a73bc3e993f4def7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:36Z,use_quota=True,user_id='5100277d035744ff9ac8e7e06d4abd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Creating volume 782fb295-f88d-4f75-9a68-36912c536a5d {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:30:35 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:35 devstack sudo[86253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d 1073741824 Feb 27 12:30:35 devstack sudo[86253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:35 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-1b838f5e-1f80-4bcd-be12-555becdc3c81 tempest-SnapshotsActionsTest-949698680 None] Create snapshot completed successfully Feb 27 12:30:35 devstack sudo[86250]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-359a246f-577b-42b1-9e1f-8c870de50a97 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dd812c4-6093-4529-8881-586c4b08ee68" returned: 0 in 0.444s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:35 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-359a246f-577b-42b1-9e1f-8c870de50a97 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Lock "cinder-quobyte-1dd812c4-6093-4529-8881-586c4b08ee68" released by "delete_volume" :: held 1.041s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-359a246f-577b-42b1-9e1f-8c870de50a97 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Created reservations ['54c24ea4-5e3e-45d7-9af3-3cc14432829c', '683ea26c-e6b8-4294-8cf2-14f7e581e16a', 'b75a140f-c5df-4d3b-9112-9a8110229b6e', 'f8362a87-d35a-437e-9c86-848f436eee16'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-359a246f-577b-42b1-9e1f-8c870de50a97 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-359a246f-577b-42b1-9e1f-8c870de50a97 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-359a246f-577b-42b1-9e1f-8c870de50a97 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-359a246f-577b-42b1-9e1f-8c870de50a97 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-359a246f-577b-42b1-9e1f-8c870de50a97 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-359a246f-577b-42b1-9e1f-8c870de50a97 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:36 devstack sudo[86259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:30:36 devstack sudo[86259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:36 devstack sudo[86253]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d 1073741824" returned: 0 in 0.496s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:36 devstack sudo[86261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d Feb 27 12:30:36 devstack sudo[86261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:36 devstack sudo[86259]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-359a246f-577b-42b1-9e1f-8c870de50a97 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.407s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-359a246f-577b-42b1-9e1f-8c870de50a97 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:30:36 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-359a246f-577b-42b1-9e1f-8c870de50a97 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Deleted volume successfully. Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-359a246f-577b-42b1-9e1f-8c870de50a97 tempest-VolumeQuotasNegativeTestJSON-1070949108 None] Lock "cinder-1dd812c4-6093-4529-8881-586c4b08ee68-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d82e6de6-6bcc-4b4c-ac79-c6fe11f7d3bb tempest-SnapshotsActionsTest-2029429911 None] Acquiring lock "cinder-a08bc242-b03a-4536-a224-c02e88b67c3e-delete_snapshot" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d82e6de6-6bcc-4b4c-ac79-c6fe11f7d3bb tempest-SnapshotsActionsTest-2029429911 None] Lock "cinder-a08bc242-b03a-4536-a224-c02e88b67c3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d82e6de6-6bcc-4b4c-ac79-c6fe11f7d3bb tempest-SnapshotsActionsTest-2029429911 None] Acquiring lock "cinder-quobyte-43f67406-a5db-4446-a1f6-919436b2057b" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d82e6de6-6bcc-4b4c-ac79-c6fe11f7d3bb tempest-SnapshotsActionsTest-2029429911 None] Lock "cinder-quobyte-43f67406-a5db-4446-a1f6-919436b2057b" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d82e6de6-6bcc-4b4c-ac79-c6fe11f7d3bb tempest-SnapshotsActionsTest-2029429911 None] Acquiring lock "cinder-quobyte-a08bc242-b03a-4536-a224-c02e88b67c3e" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:36 devstack sudo[86261]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d" returned: 0 in 0.405s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d82e6de6-6bcc-4b4c-ac79-c6fe11f7d3bb tempest-SnapshotsActionsTest-2029429911 None] Lock "cinder-quobyte-a08bc242-b03a-4536-a224-c02e88b67c3e" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-d82e6de6-6bcc-4b4c-ac79-c6fe11f7d3bb tempest-SnapshotsActionsTest-2029429911 None] Deleting offline snapshot a08bc242-b03a-4536-a224-c02e88b67c3e of volume 43f67406-a5db-4446-a1f6-919436b2057b {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-d82e6de6-6bcc-4b4c-ac79-c6fe11f7d3bb tempest-SnapshotsActionsTest-2029429911 None] snapshot_file for this snap is: volume-43f67406-a5db-4446-a1f6-919436b2057b.a08bc242-b03a-4536-a224-c02e88b67c3e {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc79dad7-93e5-41bf-9cc9-2259513cda43]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d82e6de6-6bcc-4b4c-ac79-c6fe11f7d3bb tempest-SnapshotsActionsTest-2029429911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.a08bc242-b03a-4536-a224-c02e88b67c3e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a25ea7-bc19-48a4-b441-4a91df0cf0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-782fb295-f88d-4f75-9a68-36912c536a5d', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e5c765-bc89-40bd-94d0-8be91c23732b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:36 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Volume volume-782fb295-f88d-4f75-9a68-36912c536a5d (782fb295-f88d-4f75-9a68-36912c536a5d): created successfully Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e5c765-bc89-40bd-94d0-8be91c23732b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:36 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Flow 'volume_create_manager' (44acd761-ce60-46d8-ab6a-91db40d7cbd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:36 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-e8a331f1-fa4c-49ca-a9fa-2217c0222376 tempest-VolumesSnapshotTestJSON-246952173 None] Created volume successfully. Feb 27 12:30:36 devstack sudo[86265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.a08bc242-b03a-4536-a224-c02e88b67c3e Feb 27 12:30:36 devstack sudo[86265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:37 devstack sudo[86265]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d82e6de6-6bcc-4b4c-ac79-c6fe11f7d3bb tempest-SnapshotsActionsTest-2029429911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.a08bc242-b03a-4536-a224-c02e88b67c3e" returned: 0 in 0.610s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:37 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-d82e6de6-6bcc-4b4c-ac79-c6fe11f7d3bb tempest-SnapshotsActionsTest-2029429911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f67406-a5db-4446-a1f6-919436b2057b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:30:37 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb02afa-8dae-476e-9a0c-5aa5c77d88c2]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d82e6de6-6bcc-4b4c-ac79-c6fe11f7d3bb tempest-SnapshotsActionsTest-2029429911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:37 devstack sudo[86296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 Feb 27 12:30:37 devstack sudo[86296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:37 devstack sudo[86296]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d82e6de6-6bcc-4b4c-ac79-c6fe11f7d3bb tempest-SnapshotsActionsTest-2029429911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1" returned: 0 in 0.607s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:37 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-d82e6de6-6bcc-4b4c-ac79-c6fe11f7d3bb tempest-SnapshotsActionsTest-2029429911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f67406-a5db-4446-a1f6-919436b2057b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:30:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d82e6de6-6bcc-4b4c-ac79-c6fe11f7d3bb tempest-SnapshotsActionsTest-2029429911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.a08bc242-b03a-4536-a224-c02e88b67c3e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:37 devstack sudo[86302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.a08bc242-b03a-4536-a224-c02e88b67c3e Feb 27 12:30:37 devstack sudo[86302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ce08a70d-eedd-41de-8959-32bd48b9a250 tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ce08a70d-eedd-41de-8959-32bd48b9a250 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:37 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-ce08a70d-eedd-41de-8959-32bd48b9a250 tempest-VolumesSnapshotTestJSON-246952173 None] Creating offline snapshot 90e9c6d0-08e6-43b8-ab30-0628774d7607 of volume 782fb295-f88d-4f75-9a68-36912c536a5d {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:30:38 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[46aa2f89-bbb4-4a23-93f1-8fca1a789921]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ce08a70d-eedd-41de-8959-32bd48b9a250 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:38 devstack sudo[86304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d Feb 27 12:30:38 devstack sudo[86304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:38 devstack sudo[86302]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d82e6de6-6bcc-4b4c-ac79-c6fe11f7d3bb tempest-SnapshotsActionsTest-2029429911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.a08bc242-b03a-4536-a224-c02e88b67c3e" returned: 0 in 0.711s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d82e6de6-6bcc-4b4c-ac79-c6fe11f7d3bb tempest-SnapshotsActionsTest-2029429911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.a08bc242-b03a-4536-a224-c02e88b67c3e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:38 devstack sudo[86309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.a08bc242-b03a-4536-a224-c02e88b67c3e Feb 27 12:30:38 devstack sudo[86309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:38 devstack sudo[86304]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ce08a70d-eedd-41de-8959-32bd48b9a250 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d" returned: 0 in 0.694s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ce08a70d-eedd-41de-8959-32bd48b9a250 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d.90e9c6d0-08e6-43b8-ab30-0628774d7607 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:38 devstack sudo[86314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d.90e9c6d0-08e6-43b8-ab30-0628774d7607 1G Feb 27 12:30:38 devstack sudo[86314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:39 devstack sudo[86309]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d82e6de6-6bcc-4b4c-ac79-c6fe11f7d3bb tempest-SnapshotsActionsTest-2029429911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.a08bc242-b03a-4536-a224-c02e88b67c3e" returned: 0 in 0.646s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:39 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d82e6de6-6bcc-4b4c-ac79-c6fe11f7d3bb tempest-SnapshotsActionsTest-2029429911 None] Lock "cinder-quobyte-a08bc242-b03a-4536-a224-c02e88b67c3e" released by "_delete_snapshot" :: held 2.663s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:39 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d82e6de6-6bcc-4b4c-ac79-c6fe11f7d3bb tempest-SnapshotsActionsTest-2029429911 None] Lock "cinder-quobyte-43f67406-a5db-4446-a1f6-919436b2057b" released by "delete_snapshot" :: held 2.678s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:39 devstack cinder-volume[83077]: WARNING cinder.quota [None req-d82e6de6-6bcc-4b4c-ac79-c6fe11f7d3bb tempest-SnapshotsActionsTest-2029429911 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:30:39 devstack sudo[86314]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ce08a70d-eedd-41de-8959-32bd48b9a250 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d.90e9c6d0-08e6-43b8-ab30-0628774d7607 1G" returned: 0 in 0.590s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ce08a70d-eedd-41de-8959-32bd48b9a250 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-782fb295-f88d-4f75-9a68-36912c536a5d -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d.90e9c6d0-08e6-43b8-ab30-0628774d7607 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:39 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-d82e6de6-6bcc-4b4c-ac79-c6fe11f7d3bb tempest-SnapshotsActionsTest-2029429911 None] Created reservations ['8f4da8f2-6c0c-4bd8-9e32-0826677497b0', '911e3686-1b73-426e-82d1-3af6d7f1fef7', 'd97bce7c-1b63-401c-b563-e790090b36cc', '42dcb3ce-c9d1-4f28-8607-05b22bde413e'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:39 devstack sudo[86320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-782fb295-f88d-4f75-9a68-36912c536a5d -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d.90e9c6d0-08e6-43b8-ab30-0628774d7607 Feb 27 12:30:39 devstack sudo[86320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:39 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-d82e6de6-6bcc-4b4c-ac79-c6fe11f7d3bb tempest-SnapshotsActionsTest-2029429911 None] Delete snapshot completed successfully. Feb 27 12:30:39 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d82e6de6-6bcc-4b4c-ac79-c6fe11f7d3bb tempest-SnapshotsActionsTest-2029429911 None] Lock "cinder-a08bc242-b03a-4536-a224-c02e88b67c3e-delete_snapshot" released by "delete_snapshot" :: held 2.841s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:39 devstack sudo[86320]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ce08a70d-eedd-41de-8959-32bd48b9a250 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-782fb295-f88d-4f75-9a68-36912c536a5d -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d.90e9c6d0-08e6-43b8-ab30-0628774d7607" returned: 0 in 0.546s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:39 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-ce08a70d-eedd-41de-8959-32bd48b9a250 tempest-VolumesSnapshotTestJSON-246952173 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d.90e9c6d0-08e6-43b8-ab30-0628774d7607 is being set with open permissions: ugo+rw Feb 27 12:30:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ce08a70d-eedd-41de-8959-32bd48b9a250 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d.90e9c6d0-08e6-43b8-ab30-0628774d7607 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:39 devstack sudo[86325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d.90e9c6d0-08e6-43b8-ab30-0628774d7607 Feb 27 12:30:39 devstack sudo[86325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-9ff8dfda-b013-41a6-a625-08f20ead7685 tempest-SnapshotsActionsTest-949698680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:40 devstack sudo[86325]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ce08a70d-eedd-41de-8959-32bd48b9a250 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d.90e9c6d0-08e6-43b8-ab30-0628774d7607" returned: 0 in 0.550s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ce08a70d-eedd-41de-8959-32bd48b9a250 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:40 devstack sudo[86328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d.info Feb 27 12:30:40 devstack sudo[86328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:40 devstack sudo[86328]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ce08a70d-eedd-41de-8959-32bd48b9a250 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d.info" returned: 0 in 0.525s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:40 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-ce08a70d-eedd-41de-8959-32bd48b9a250 tempest-VolumesSnapshotTestJSON-246952173 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d.info is being set with open permissions: ugo+rw Feb 27 12:30:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ce08a70d-eedd-41de-8959-32bd48b9a250 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:40 devstack sudo[86334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d.info Feb 27 12:30:40 devstack sudo[86334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:41 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:30:41 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Flow 'volume_create_manager' (84a3091b-4180-4403-a18f-8de0131fc795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:41 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb0a9d28-e4fd-40f6-95f4-1bbc40a0d95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:41 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb0a9d28-e4fd-40f6-95f4-1bbc40a0d95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-952766246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e62877-533f-4a4d-a1b1-af3bdfe25f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3cfc0550b14c48b2964d816390d754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:41Z,use_quota=True,user_id='f512ea78ee254cdca8a06e101496c17a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58409af8-4cb2-452a-9d59-f693d18040a5),volume_type_id=58409af8-4cb2-452a-9d59-f693d18040a5)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:41 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a7f2ca-eac6-443b-a46c-6fd60eb899e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:41 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a7f2ca-eac6-443b-a46c-6fd60eb899e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:41 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d63436e-36a1-428e-ade1-33e1fd9a5b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:41 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d63436e-36a1-428e-ade1-33e1fd9a5b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8e62877-533f-4a4d-a1b1-af3bdfe25f95', 'volume_name': 'volume-a8e62877-533f-4a4d-a1b1-af3bdfe25f95', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:41 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (975301eb-ea4b-4fc1-9cad-a0e2966c7c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:41 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (975301eb-ea4b-4fc1-9cad-a0e2966c7c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:41 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb37ae42-1a45-4ce1-8558-c7f21e9e9b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:41 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Volume a8e62877-533f-4a4d-a1b1-af3bdfe25f95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8e62877-533f-4a4d-a1b1-af3bdfe25f95', 'volume_size': 1} Feb 27 12:30:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:41 devstack sudo[86334]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ce08a70d-eedd-41de-8959-32bd48b9a250 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d.info" returned: 0 in 0.432s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ce08a70d-eedd-41de-8959-32bd48b9a250 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.408s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-9ff8dfda-b013-41a6-a625-08f20ead7685 tempest-SnapshotsActionsTest-949698680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.419s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:41 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-9ff8dfda-b013-41a6-a625-08f20ead7685 tempest-SnapshotsActionsTest-949698680 None] Creating offline snapshot d70bc380-ca0a-4063-baef-65ee6aa1d41c of volume 43f67406-a5db-4446-a1f6-919436b2057b {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:30:41 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8f64f6-d8a9-45ae-a6dd-8ffd115d22fc]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9ff8dfda-b013-41a6-a625-08f20ead7685 tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:41 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-ce08a70d-eedd-41de-8959-32bd48b9a250 tempest-VolumesSnapshotTestJSON-246952173 None] Create snapshot completed successfully Feb 27 12:30:41 devstack sudo[86337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 Feb 27 12:30:41 devstack sudo[86337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:41 devstack sudo[86337]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9ff8dfda-b013-41a6-a625-08f20ead7685 tempest-SnapshotsActionsTest-949698680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1" returned: 0 in 0.473s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:41 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-9ff8dfda-b013-41a6-a625-08f20ead7685 tempest-SnapshotsActionsTest-949698680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f67406-a5db-4446-a1f6-919436b2057b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:30:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9ff8dfda-b013-41a6-a625-08f20ead7685 tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.d70bc380-ca0a-4063-baef-65ee6aa1d41c 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:41 devstack sudo[86342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.d70bc380-ca0a-4063-baef-65ee6aa1d41c 1G Feb 27 12:30:41 devstack sudo[86342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:42 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-63f9cde5-4467-4214-bbd6-bb90f3ab9075 tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "cinder-90e9c6d0-08e6-43b8-ab30-0628774d7607-delete_snapshot" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:42 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-63f9cde5-4467-4214-bbd6-bb90f3ab9075 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-90e9c6d0-08e6-43b8-ab30-0628774d7607-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:42 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-63f9cde5-4467-4214-bbd6-bb90f3ab9075 tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "cinder-quobyte-782fb295-f88d-4f75-9a68-36912c536a5d" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:42 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-63f9cde5-4467-4214-bbd6-bb90f3ab9075 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-782fb295-f88d-4f75-9a68-36912c536a5d" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:42 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-63f9cde5-4467-4214-bbd6-bb90f3ab9075 tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "cinder-quobyte-90e9c6d0-08e6-43b8-ab30-0628774d7607" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:42 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-63f9cde5-4467-4214-bbd6-bb90f3ab9075 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-90e9c6d0-08e6-43b8-ab30-0628774d7607" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:42 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-63f9cde5-4467-4214-bbd6-bb90f3ab9075 tempest-VolumesSnapshotTestJSON-246952173 None] Deleting offline snapshot 90e9c6d0-08e6-43b8-ab30-0628774d7607 of volume 782fb295-f88d-4f75-9a68-36912c536a5d {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:30:42 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-63f9cde5-4467-4214-bbd6-bb90f3ab9075 tempest-VolumesSnapshotTestJSON-246952173 None] snapshot_file for this snap is: volume-782fb295-f88d-4f75-9a68-36912c536a5d.90e9c6d0-08e6-43b8-ab30-0628774d7607 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:30:42 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[174471be-b8f2-40c8-9a81-066f08d86ff5]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-63f9cde5-4467-4214-bbd6-bb90f3ab9075 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d.90e9c6d0-08e6-43b8-ab30-0628774d7607 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:42 devstack sudo[86346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d.90e9c6d0-08e6-43b8-ab30-0628774d7607 Feb 27 12:30:42 devstack sudo[86346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:42 devstack sudo[86342]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9ff8dfda-b013-41a6-a625-08f20ead7685 tempest-SnapshotsActionsTest-949698680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.d70bc380-ca0a-4063-baef-65ee6aa1d41c 1G" returned: 0 in 0.595s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9ff8dfda-b013-41a6-a625-08f20ead7685 tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.d70bc380-ca0a-4063-baef-65ee6aa1d41c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:42 devstack sudo[86349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.d70bc380-ca0a-4063-baef-65ee6aa1d41c Feb 27 12:30:42 devstack sudo[86349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:42 devstack sudo[86346]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-63f9cde5-4467-4214-bbd6-bb90f3ab9075 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d.90e9c6d0-08e6-43b8-ab30-0628774d7607" returned: 0 in 0.492s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:42 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-63f9cde5-4467-4214-bbd6-bb90f3ab9075 tempest-VolumesSnapshotTestJSON-246952173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-782fb295-f88d-4f75-9a68-36912c536a5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:30:42 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a95a44d-46c9-4c09-bde6-bbc251f2960c]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-63f9cde5-4467-4214-bbd6-bb90f3ab9075 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:42 devstack sudo[86355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d Feb 27 12:30:42 devstack sudo[86355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:42 devstack sudo[86349]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9ff8dfda-b013-41a6-a625-08f20ead7685 tempest-SnapshotsActionsTest-949698680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.d70bc380-ca0a-4063-baef-65ee6aa1d41c" returned: 0 in 0.418s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:42 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-9ff8dfda-b013-41a6-a625-08f20ead7685 tempest-SnapshotsActionsTest-949698680 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.d70bc380-ca0a-4063-baef-65ee6aa1d41c is being set with open permissions: ugo+rw Feb 27 12:30:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9ff8dfda-b013-41a6-a625-08f20ead7685 tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.d70bc380-ca0a-4063-baef-65ee6aa1d41c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:42 devstack sudo[86359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.d70bc380-ca0a-4063-baef-65ee6aa1d41c Feb 27 12:30:42 devstack sudo[86359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:43 devstack sudo[86359]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:43 devstack sudo[86355]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9ff8dfda-b013-41a6-a625-08f20ead7685 tempest-SnapshotsActionsTest-949698680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.d70bc380-ca0a-4063-baef-65ee6aa1d41c" returned: 0 in 0.420s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-9ff8dfda-b013-41a6-a625-08f20ead7685 tempest-SnapshotsActionsTest-949698680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.966s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.108s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:43 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-952766246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e62877-533f-4a4d-a1b1-af3bdfe25f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3cfc0550b14c48b2964d816390d754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:41Z,use_quota=True,user_id='f512ea78ee254cdca8a06e101496c17a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58409af8-4cb2-452a-9d59-f693d18040a5),volume_type_id=58409af8-4cb2-452a-9d59-f693d18040a5)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:30:43 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Creating volume a8e62877-533f-4a4d-a1b1-af3bdfe25f95 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:30:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:43 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:43 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:43 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:30:43 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:30:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a8e62877-533f-4a4d-a1b1-af3bdfe25f95 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-63f9cde5-4467-4214-bbd6-bb90f3ab9075 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d" returned: 0 in 0.551s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-63f9cde5-4467-4214-bbd6-bb90f3ab9075 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d.90e9c6d0-08e6-43b8-ab30-0628774d7607 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:43 devstack sudo[86365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a8e62877-533f-4a4d-a1b1-af3bdfe25f95 1073741824 Feb 27 12:30:43 devstack sudo[86365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:43 devstack sudo[86367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d.90e9c6d0-08e6-43b8-ab30-0628774d7607 Feb 27 12:30:43 devstack sudo[86367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:43 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-9ff8dfda-b013-41a6-a625-08f20ead7685 tempest-SnapshotsActionsTest-949698680 None] Create snapshot completed successfully Feb 27 12:30:43 devstack sudo[86367]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-63f9cde5-4467-4214-bbd6-bb90f3ab9075 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d.90e9c6d0-08e6-43b8-ab30-0628774d7607" returned: 0 in 0.458s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-63f9cde5-4467-4214-bbd6-bb90f3ab9075 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d.90e9c6d0-08e6-43b8-ab30-0628774d7607 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:43 devstack sudo[86375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d.90e9c6d0-08e6-43b8-ab30-0628774d7607 Feb 27 12:30:43 devstack sudo[86375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:43 devstack sudo[86365]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a8e62877-533f-4a4d-a1b1-af3bdfe25f95 1073741824" returned: 0 in 0.502s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a8e62877-533f-4a4d-a1b1-af3bdfe25f95 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:43 devstack sudo[86377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a8e62877-533f-4a4d-a1b1-af3bdfe25f95 Feb 27 12:30:43 devstack sudo[86377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:44 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cfafb5c9-5f9b-4772-8a7f-bbc7799ff7a0 tempest-SnapshotsActionsTest-2029429911 None] Acquiring lock "cinder-d70bc380-ca0a-4063-baef-65ee6aa1d41c-delete_snapshot" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:44 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cfafb5c9-5f9b-4772-8a7f-bbc7799ff7a0 tempest-SnapshotsActionsTest-2029429911 None] Lock "cinder-d70bc380-ca0a-4063-baef-65ee6aa1d41c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:44 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cfafb5c9-5f9b-4772-8a7f-bbc7799ff7a0 tempest-SnapshotsActionsTest-2029429911 None] Acquiring lock "cinder-quobyte-43f67406-a5db-4446-a1f6-919436b2057b" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:44 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cfafb5c9-5f9b-4772-8a7f-bbc7799ff7a0 tempest-SnapshotsActionsTest-2029429911 None] Lock "cinder-quobyte-43f67406-a5db-4446-a1f6-919436b2057b" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:44 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cfafb5c9-5f9b-4772-8a7f-bbc7799ff7a0 tempest-SnapshotsActionsTest-2029429911 None] Acquiring lock "cinder-quobyte-d70bc380-ca0a-4063-baef-65ee6aa1d41c" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:44 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cfafb5c9-5f9b-4772-8a7f-bbc7799ff7a0 tempest-SnapshotsActionsTest-2029429911 None] Lock "cinder-quobyte-d70bc380-ca0a-4063-baef-65ee6aa1d41c" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:44 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-cfafb5c9-5f9b-4772-8a7f-bbc7799ff7a0 tempest-SnapshotsActionsTest-2029429911 None] Deleting offline snapshot d70bc380-ca0a-4063-baef-65ee6aa1d41c of volume 43f67406-a5db-4446-a1f6-919436b2057b {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:30:44 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-cfafb5c9-5f9b-4772-8a7f-bbc7799ff7a0 tempest-SnapshotsActionsTest-2029429911 None] snapshot_file for this snap is: volume-43f67406-a5db-4446-a1f6-919436b2057b.d70bc380-ca0a-4063-baef-65ee6aa1d41c {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:30:44 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[695a71cd-ec27-4314-bf3c-f53b18ca9453]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cfafb5c9-5f9b-4772-8a7f-bbc7799ff7a0 tempest-SnapshotsActionsTest-2029429911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.d70bc380-ca0a-4063-baef-65ee6aa1d41c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:44 devstack sudo[86387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.d70bc380-ca0a-4063-baef-65ee6aa1d41c Feb 27 12:30:44 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:44 devstack sudo[86377]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a8e62877-533f-4a4d-a1b1-af3bdfe25f95" returned: 0 in 0.508s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:44 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:30:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb37ae42-1a45-4ce1-8558-c7f21e9e9b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8e62877-533f-4a4d-a1b1-af3bdfe25f95', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61cfbbda-ddb1-4abc-a43f-3a817bcbb9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:44 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Volume volume-a8e62877-533f-4a4d-a1b1-af3bdfe25f95 (a8e62877-533f-4a4d-a1b1-af3bdfe25f95): created successfully Feb 27 12:30:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61cfbbda-ddb1-4abc-a43f-3a817bcbb9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Flow 'volume_create_manager' (84a3091b-4180-4403-a18f-8de0131fc795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:44 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-c1415eb4-51b5-4999-bac7-550eef1dbcd1 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Created volume successfully. Feb 27 12:30:44 devstack sudo[86375]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-63f9cde5-4467-4214-bbd6-bb90f3ab9075 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d.90e9c6d0-08e6-43b8-ab30-0628774d7607" returned: 0 in 0.627s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:44 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-63f9cde5-4467-4214-bbd6-bb90f3ab9075 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-90e9c6d0-08e6-43b8-ab30-0628774d7607" released by "_delete_snapshot" :: held 2.192s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:44 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-63f9cde5-4467-4214-bbd6-bb90f3ab9075 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-782fb295-f88d-4f75-9a68-36912c536a5d" released by "delete_snapshot" :: held 2.204s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:44 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-63f9cde5-4467-4214-bbd6-bb90f3ab9075 tempest-VolumesSnapshotTestJSON-246952173 None] Created reservations ['9532be0e-c4bf-427e-bfae-85e8b4cb4cd6', 'be4d052d-445e-4d91-a473-a3272a6b074c', 'cf64f658-4b00-4c8d-b4da-d5eaa432c4b5', 'c3364ecc-b0d7-42f1-a4f6-e28616857f36'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:44 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-63f9cde5-4467-4214-bbd6-bb90f3ab9075 tempest-VolumesSnapshotTestJSON-246952173 None] Delete snapshot completed successfully. Feb 27 12:30:44 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-63f9cde5-4467-4214-bbd6-bb90f3ab9075 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-90e9c6d0-08e6-43b8-ab30-0628774d7607-delete_snapshot" released by "delete_snapshot" :: held 2.381s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:44 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cfafb5c9-5f9b-4772-8a7f-bbc7799ff7a0 tempest-SnapshotsActionsTest-2029429911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.d70bc380-ca0a-4063-baef-65ee6aa1d41c" returned: 0 in 0.518s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:44 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-cfafb5c9-5f9b-4772-8a7f-bbc7799ff7a0 tempest-SnapshotsActionsTest-2029429911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f67406-a5db-4446-a1f6-919436b2057b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:30:44 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[12268032-2b8d-41da-8c29-afd75d6c42c3]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cfafb5c9-5f9b-4772-8a7f-bbc7799ff7a0 tempest-SnapshotsActionsTest-2029429911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:44 devstack sudo[86412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 Feb 27 12:30:44 devstack sudo[86412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:45 devstack sudo[86412]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cfafb5c9-5f9b-4772-8a7f-bbc7799ff7a0 tempest-SnapshotsActionsTest-2029429911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1" returned: 0 in 0.516s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:45 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-cfafb5c9-5f9b-4772-8a7f-bbc7799ff7a0 tempest-SnapshotsActionsTest-2029429911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f67406-a5db-4446-a1f6-919436b2057b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:30:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cfafb5c9-5f9b-4772-8a7f-bbc7799ff7a0 tempest-SnapshotsActionsTest-2029429911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.d70bc380-ca0a-4063-baef-65ee6aa1d41c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:45 devstack sudo[86417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.d70bc380-ca0a-4063-baef-65ee6aa1d41c Feb 27 12:30:45 devstack sudo[86417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:45 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:30:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Flow 'volume_create_manager' (4f668d5c-1c3c-42b1-80e3-d1adf08d1364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b509b03-c430-4ec1-b991-c7ae5d29d69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:45 devstack sudo[86417]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cfafb5c9-5f9b-4772-8a7f-bbc7799ff7a0 tempest-SnapshotsActionsTest-2029429911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.d70bc380-ca0a-4063-baef-65ee6aa1d41c" returned: 0 in 0.604s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cfafb5c9-5f9b-4772-8a7f-bbc7799ff7a0 tempest-SnapshotsActionsTest-2029429911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.d70bc380-ca0a-4063-baef-65ee6aa1d41c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b509b03-c430-4ec1-b991-c7ae5d29d69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2063091886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a8516a-4dd5-4568-a2c5-97bd65bc949a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9efd9d3f52184a73bc3e993f4def7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:46Z,use_quota=True,user_id='5100277d035744ff9ac8e7e06d4abd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe47d1ae-426f-4972-90fa-b67d94454cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe47d1ae-426f-4972-90fa-b67d94454cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:45 devstack sudo[86423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.d70bc380-ca0a-4063-baef-65ee6aa1d41c Feb 27 12:30:45 devstack sudo[86423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e420e781-4ced-4604-8bcc-410e95e797fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e420e781-4ced-4604-8bcc-410e95e797fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52a8516a-4dd5-4568-a2c5-97bd65bc949a', 'volume_name': 'volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96330265-3bf6-4821-81d3-7d36c5b260d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96330265-3bf6-4821-81d3-7d36c5b260d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93805c41-92e9-48d5-b6ac-c03e1391e7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:45 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Volume 52a8516a-4dd5-4568-a2c5-97bd65bc949a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a', 'volume_size': 1} Feb 27 12:30:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:45 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2063091886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a8516a-4dd5-4568-a2c5-97bd65bc949a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9efd9d3f52184a73bc3e993f4def7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:46Z,use_quota=True,user_id='5100277d035744ff9ac8e7e06d4abd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:30:45 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Creating volume 52a8516a-4dd5-4568-a2c5-97bd65bc949a {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:30:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:45 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:45 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:45 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:30:45 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:30:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:46 devstack sudo[86425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a 1073741824 Feb 27 12:30:46 devstack sudo[86425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6294bfba-ec1c-4be2-a704-db829a40439d tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6294bfba-ec1c-4be2-a704-db829a40439d tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:46 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6294bfba-ec1c-4be2-a704-db829a40439d tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:46 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6294bfba-ec1c-4be2-a704-db829a40439d tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6294bfba-ec1c-4be2-a704-db829a40439d tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6294bfba-ec1c-4be2-a704-db829a40439d tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:46 devstack sudo[86427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:30:46 devstack sudo[86427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:46 devstack sudo[86427]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6294bfba-ec1c-4be2-a704-db829a40439d tempest-VolumeRetypeWithoutMigrationTest-477480713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.500s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:46 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-6294bfba-ec1c-4be2-a704-db829a40439d tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:30:46 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-6294bfba-ec1c-4be2-a704-db829a40439d tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Retype volume completed successfully. Feb 27 12:30:46 devstack sudo[86423]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cfafb5c9-5f9b-4772-8a7f-bbc7799ff7a0 tempest-SnapshotsActionsTest-2029429911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.d70bc380-ca0a-4063-baef-65ee6aa1d41c" returned: 0 in 0.671s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:46 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cfafb5c9-5f9b-4772-8a7f-bbc7799ff7a0 tempest-SnapshotsActionsTest-2029429911 None] Lock "cinder-quobyte-d70bc380-ca0a-4063-baef-65ee6aa1d41c" released by "_delete_snapshot" :: held 2.372s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:46 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cfafb5c9-5f9b-4772-8a7f-bbc7799ff7a0 tempest-SnapshotsActionsTest-2029429911 None] Lock "cinder-quobyte-43f67406-a5db-4446-a1f6-919436b2057b" released by "delete_snapshot" :: held 2.388s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:46 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-cfafb5c9-5f9b-4772-8a7f-bbc7799ff7a0 tempest-SnapshotsActionsTest-2029429911 None] Created reservations ['61ce599a-7ca8-4fc0-a1f8-8391997f34f8', '78e0ab39-9d6d-4c7c-886d-42d90ca8d576', '04e4e477-ed2c-41ae-85cd-0723368e35f2', '1b39bf20-4d96-4f23-a4ff-53df7d4a19e7'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:46 devstack sudo[86425]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a 1073741824" returned: 0 in 0.693s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:46 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-cfafb5c9-5f9b-4772-8a7f-bbc7799ff7a0 tempest-SnapshotsActionsTest-2029429911 None] Delete snapshot completed successfully. Feb 27 12:30:46 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cfafb5c9-5f9b-4772-8a7f-bbc7799ff7a0 tempest-SnapshotsActionsTest-2029429911 None] Lock "cinder-d70bc380-ca0a-4063-baef-65ee6aa1d41c-delete_snapshot" released by "delete_snapshot" :: held 2.511s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:46 devstack sudo[86434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a Feb 27 12:30:46 devstack sudo[86434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:47 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a4de756f-37dc-43d2-989f-f140cc4184d0 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Acquiring lock "cinder-a8e62877-533f-4a4d-a1b1-af3bdfe25f95-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:47 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a4de756f-37dc-43d2-989f-f140cc4184d0 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Lock "cinder-a8e62877-533f-4a4d-a1b1-af3bdfe25f95-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:47 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a4de756f-37dc-43d2-989f-f140cc4184d0 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Acquiring lock "cinder-quobyte-a8e62877-533f-4a4d-a1b1-af3bdfe25f95" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:47 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a4de756f-37dc-43d2-989f-f140cc4184d0 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Lock "cinder-quobyte-a8e62877-533f-4a4d-a1b1-af3bdfe25f95" acquired by "delete_volume" :: waited 0.007s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:47 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[296875c4-43bf-486b-b5f1-44171b5532be]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a4de756f-37dc-43d2-989f-f140cc4184d0 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a8e62877-533f-4a4d-a1b1-af3bdfe25f95 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:47 devstack sudo[86434]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a" returned: 0 in 0.610s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:47 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:30:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93805c41-92e9-48d5-b6ac-c03e1391e7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fcca36f-5951-439c-a4be-5d271af4e120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:47 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Volume volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a (52a8516a-4dd5-4568-a2c5-97bd65bc949a): created successfully Feb 27 12:30:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fcca36f-5951-439c-a4be-5d271af4e120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Flow 'volume_create_manager' (4f668d5c-1c3c-42b1-80e3-d1adf08d1364) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:47 devstack sudo[86437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a8e62877-533f-4a4d-a1b1-af3bdfe25f95 Feb 27 12:30:47 devstack sudo[86437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:47 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-b3d4d43c-80b6-42c0-9e2f-77f5e1c82b3b tempest-VolumesSnapshotTestJSON-246952173 None] Created volume successfully. Feb 27 12:30:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-3f86dc71-30bb-4009-b669-3b630b318ce8 tempest-SnapshotsActionsTest-949698680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-3f86dc71-30bb-4009-b669-3b630b318ce8 tempest-SnapshotsActionsTest-949698680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:47 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-3f86dc71-30bb-4009-b669-3b630b318ce8 tempest-SnapshotsActionsTest-949698680 None] Creating offline snapshot 50db5677-3353-48fd-a84d-56fb06914e74 of volume 43f67406-a5db-4446-a1f6-919436b2057b {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:30:47 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0772df7-5a6f-4d9c-a6c8-da6288070ddc]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-3f86dc71-30bb-4009-b669-3b630b318ce8 tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:47 devstack sudo[86439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 Feb 27 12:30:47 devstack sudo[86439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:47 devstack sudo[86437]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a4de756f-37dc-43d2-989f-f140cc4184d0 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a8e62877-533f-4a4d-a1b1-af3bdfe25f95" returned: 0 in 0.570s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a4de756f-37dc-43d2-989f-f140cc4184d0 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a8e62877-533f-4a4d-a1b1-af3bdfe25f95 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:47 devstack sudo[86444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a8e62877-533f-4a4d-a1b1-af3bdfe25f95 Feb 27 12:30:47 devstack sudo[86444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-46d99085-e12e-4071-801e-d8a92e4d1a06 tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:48 devstack sudo[86439]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-3f86dc71-30bb-4009-b669-3b630b318ce8 tempest-SnapshotsActionsTest-949698680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1" returned: 0 in 0.530s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:48 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-3f86dc71-30bb-4009-b669-3b630b318ce8 tempest-SnapshotsActionsTest-949698680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f67406-a5db-4446-a1f6-919436b2057b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:30:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-3f86dc71-30bb-4009-b669-3b630b318ce8 tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.50db5677-3353-48fd-a84d-56fb06914e74 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:48 devstack sudo[86449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.50db5677-3353-48fd-a84d-56fb06914e74 1G Feb 27 12:30:48 devstack sudo[86449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:48 devstack sudo[86444]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a4de756f-37dc-43d2-989f-f140cc4184d0 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a8e62877-533f-4a4d-a1b1-af3bdfe25f95" returned: 0 in 0.445s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:48 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a4de756f-37dc-43d2-989f-f140cc4184d0 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Lock "cinder-quobyte-a8e62877-533f-4a4d-a1b1-af3bdfe25f95" released by "delete_volume" :: held 1.041s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:48 devstack cinder-volume[83077]: WARNING cinder.quota [None req-a4de756f-37dc-43d2-989f-f140cc4184d0 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:30:48 devstack cinder-volume[83077]: WARNING cinder.quota [None req-a4de756f-37dc-43d2-989f-f140cc4184d0 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:30:48 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-a4de756f-37dc-43d2-989f-f140cc4184d0 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Created reservations ['ab0bf04f-d459-4d45-aae8-c13fc64bf765', 'da2e421a-b866-4929-aa5d-d90b44abf425', '8698948c-2897-4924-9aa6-5a60db64f148', '1ccdfa3c-2462-476b-92f6-8e538f40eb42'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a4de756f-37dc-43d2-989f-f140cc4184d0 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a4de756f-37dc-43d2-989f-f140cc4184d0 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:48 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a4de756f-37dc-43d2-989f-f140cc4184d0 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:48 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a4de756f-37dc-43d2-989f-f140cc4184d0 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a4de756f-37dc-43d2-989f-f140cc4184d0 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a4de756f-37dc-43d2-989f-f140cc4184d0 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:48 devstack sudo[86452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:30:48 devstack sudo[86452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:48 devstack sudo[86449]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-3f86dc71-30bb-4009-b669-3b630b318ce8 tempest-SnapshotsActionsTest-949698680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.50db5677-3353-48fd-a84d-56fb06914e74 1G" returned: 0 in 0.608s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-3f86dc71-30bb-4009-b669-3b630b318ce8 tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.50db5677-3353-48fd-a84d-56fb06914e74 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:48 devstack sudo[86457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.50db5677-3353-48fd-a84d-56fb06914e74 Feb 27 12:30:48 devstack sudo[86457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:48 devstack sudo[86452]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a4de756f-37dc-43d2-989f-f140cc4184d0 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.526s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:48 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-a4de756f-37dc-43d2-989f-f140cc4184d0 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:30:48 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-a4de756f-37dc-43d2-989f-f140cc4184d0 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Deleted volume successfully. Feb 27 12:30:48 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a4de756f-37dc-43d2-989f-f140cc4184d0 tempest-VolumeRetypeWithoutMigrationTest-477480713 None] Lock "cinder-a8e62877-533f-4a4d-a1b1-af3bdfe25f95-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:49 devstack sudo[86457]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-3f86dc71-30bb-4009-b669-3b630b318ce8 tempest-SnapshotsActionsTest-949698680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.50db5677-3353-48fd-a84d-56fb06914e74" returned: 0 in 0.588s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:49 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-3f86dc71-30bb-4009-b669-3b630b318ce8 tempest-SnapshotsActionsTest-949698680 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.50db5677-3353-48fd-a84d-56fb06914e74 is being set with open permissions: ugo+rw Feb 27 12:30:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-3f86dc71-30bb-4009-b669-3b630b318ce8 tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.50db5677-3353-48fd-a84d-56fb06914e74 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:49 devstack sudo[86466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.50db5677-3353-48fd-a84d-56fb06914e74 Feb 27 12:30:49 devstack sudo[86466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:49 devstack sudo[86466]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-3f86dc71-30bb-4009-b669-3b630b318ce8 tempest-SnapshotsActionsTest-949698680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.50db5677-3353-48fd-a84d-56fb06914e74" returned: 0 in 0.483s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-3f86dc71-30bb-4009-b669-3b630b318ce8 tempest-SnapshotsActionsTest-949698680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.268s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-46d99085-e12e-4071-801e-d8a92e4d1a06 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.804s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:49 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-3f86dc71-30bb-4009-b669-3b630b318ce8 tempest-SnapshotsActionsTest-949698680 None] Create snapshot completed successfully Feb 27 12:30:49 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-46d99085-e12e-4071-801e-d8a92e4d1a06 tempest-VolumesSnapshotTestJSON-246952173 None] Creating offline snapshot bf752d4c-ef59-43e9-abc0-46a724d2c30d of volume 52a8516a-4dd5-4568-a2c5-97bd65bc949a {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:30:49 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e809d8a-34c4-4ad5-b883-75f87908c14c]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-46d99085-e12e-4071-801e-d8a92e4d1a06 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:49 devstack sudo[86469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a Feb 27 12:30:49 devstack sudo[86469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:50 devstack sudo[86469]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-46d99085-e12e-4071-801e-d8a92e4d1a06 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a" returned: 0 in 0.631s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-46d99085-e12e-4071-801e-d8a92e4d1a06 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.bf752d4c-ef59-43e9-abc0-46a724d2c30d 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:50 devstack sudo[86474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.bf752d4c-ef59-43e9-abc0-46a724d2c30d 1G Feb 27 12:30:50 devstack sudo[86474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:50 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d38acfde-78ec-4772-b632-b1dec4c77241 tempest-SnapshotsActionsTest-2029429911 None] Acquiring lock "cinder-50db5677-3353-48fd-a84d-56fb06914e74-delete_snapshot" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:50 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d38acfde-78ec-4772-b632-b1dec4c77241 tempest-SnapshotsActionsTest-2029429911 None] Lock "cinder-50db5677-3353-48fd-a84d-56fb06914e74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:50 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d38acfde-78ec-4772-b632-b1dec4c77241 tempest-SnapshotsActionsTest-2029429911 None] Acquiring lock "cinder-quobyte-43f67406-a5db-4446-a1f6-919436b2057b" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:50 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d38acfde-78ec-4772-b632-b1dec4c77241 tempest-SnapshotsActionsTest-2029429911 None] Lock "cinder-quobyte-43f67406-a5db-4446-a1f6-919436b2057b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:50 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d38acfde-78ec-4772-b632-b1dec4c77241 tempest-SnapshotsActionsTest-2029429911 None] Acquiring lock "cinder-quobyte-50db5677-3353-48fd-a84d-56fb06914e74" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:50 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d38acfde-78ec-4772-b632-b1dec4c77241 tempest-SnapshotsActionsTest-2029429911 None] Lock "cinder-quobyte-50db5677-3353-48fd-a84d-56fb06914e74" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:50 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-d38acfde-78ec-4772-b632-b1dec4c77241 tempest-SnapshotsActionsTest-2029429911 None] Deleting offline snapshot 50db5677-3353-48fd-a84d-56fb06914e74 of volume 43f67406-a5db-4446-a1f6-919436b2057b {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:30:50 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-d38acfde-78ec-4772-b632-b1dec4c77241 tempest-SnapshotsActionsTest-2029429911 None] snapshot_file for this snap is: volume-43f67406-a5db-4446-a1f6-919436b2057b.50db5677-3353-48fd-a84d-56fb06914e74 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:30:50 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[962d0d3f-7eca-4542-8959-3814ede39218]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d38acfde-78ec-4772-b632-b1dec4c77241 tempest-SnapshotsActionsTest-2029429911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.50db5677-3353-48fd-a84d-56fb06914e74 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:51 devstack sudo[86477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.50db5677-3353-48fd-a84d-56fb06914e74 Feb 27 12:30:51 devstack sudo[86477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:51 devstack sudo[86474]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-46d99085-e12e-4071-801e-d8a92e4d1a06 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.bf752d4c-ef59-43e9-abc0-46a724d2c30d 1G" returned: 0 in 0.675s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-46d99085-e12e-4071-801e-d8a92e4d1a06 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.bf752d4c-ef59-43e9-abc0-46a724d2c30d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:51 devstack sudo[86482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.bf752d4c-ef59-43e9-abc0-46a724d2c30d Feb 27 12:30:51 devstack sudo[86482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:51 devstack sudo[86477]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d38acfde-78ec-4772-b632-b1dec4c77241 tempest-SnapshotsActionsTest-2029429911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.50db5677-3353-48fd-a84d-56fb06914e74" returned: 0 in 0.666s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:51 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-d38acfde-78ec-4772-b632-b1dec4c77241 tempest-SnapshotsActionsTest-2029429911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f67406-a5db-4446-a1f6-919436b2057b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:30:51 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf759524-385b-4b19-93c1-953d4c6e0be6]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d38acfde-78ec-4772-b632-b1dec4c77241 tempest-SnapshotsActionsTest-2029429911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:51 devstack sudo[86487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 Feb 27 12:30:51 devstack sudo[86487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:51 devstack sudo[86482]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-46d99085-e12e-4071-801e-d8a92e4d1a06 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.bf752d4c-ef59-43e9-abc0-46a724d2c30d" returned: 0 in 0.568s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:51 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-46d99085-e12e-4071-801e-d8a92e4d1a06 tempest-VolumesSnapshotTestJSON-246952173 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.bf752d4c-ef59-43e9-abc0-46a724d2c30d is being set with open permissions: ugo+rw Feb 27 12:30:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-46d99085-e12e-4071-801e-d8a92e4d1a06 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.bf752d4c-ef59-43e9-abc0-46a724d2c30d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:51 devstack sudo[86492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.bf752d4c-ef59-43e9-abc0-46a724d2c30d Feb 27 12:30:51 devstack sudo[86492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:52 devstack sudo[86487]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d38acfde-78ec-4772-b632-b1dec4c77241 tempest-SnapshotsActionsTest-2029429911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1" returned: 0 in 0.662s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:52 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-d38acfde-78ec-4772-b632-b1dec4c77241 tempest-SnapshotsActionsTest-2029429911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f67406-a5db-4446-a1f6-919436b2057b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:30:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d38acfde-78ec-4772-b632-b1dec4c77241 tempest-SnapshotsActionsTest-2029429911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.50db5677-3353-48fd-a84d-56fb06914e74 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:52 devstack sudo[86498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.50db5677-3353-48fd-a84d-56fb06914e74 Feb 27 12:30:52 devstack sudo[86498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:52 devstack sudo[86492]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-46d99085-e12e-4071-801e-d8a92e4d1a06 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.bf752d4c-ef59-43e9-abc0-46a724d2c30d" returned: 0 in 0.587s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-46d99085-e12e-4071-801e-d8a92e4d1a06 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:52 devstack sudo[86500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.info Feb 27 12:30:52 devstack sudo[86500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:52 devstack sudo[86500]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-46d99085-e12e-4071-801e-d8a92e4d1a06 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.info" returned: 0 in 0.499s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:52 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-46d99085-e12e-4071-801e-d8a92e4d1a06 tempest-VolumesSnapshotTestJSON-246952173 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.info is being set with open permissions: ugo+rw Feb 27 12:30:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-46d99085-e12e-4071-801e-d8a92e4d1a06 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:52 devstack sudo[86506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.info Feb 27 12:30:52 devstack sudo[86506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:52 devstack sudo[86498]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d38acfde-78ec-4772-b632-b1dec4c77241 tempest-SnapshotsActionsTest-2029429911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.50db5677-3353-48fd-a84d-56fb06914e74" returned: 0 in 0.687s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d38acfde-78ec-4772-b632-b1dec4c77241 tempest-SnapshotsActionsTest-2029429911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.50db5677-3353-48fd-a84d-56fb06914e74 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:52 devstack sudo[86508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.50db5677-3353-48fd-a84d-56fb06914e74 Feb 27 12:30:52 devstack sudo[86508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Flow 'volume_create_manager' (a3f57747-959b-4232-85f9-315d4675698a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15936778-3456-4768-8819-3768e57a9fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15936778-3456-4768-8819-3768e57a9fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-53260997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df825d0-4c2d-4d2e-962b-eaa3952c6c5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b9295d2a704f2ab265d99d0ad9ff1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:53Z,use_quota=True,user_id='a0548fa0b0114f8d9a6c4718181614c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a654cd0-7449-493f-9be5-cefc0ebb2298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a654cd0-7449-493f-9be5-cefc0ebb2298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a8091cb-9329-4d1b-953c-fe5bf9768607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a8091cb-9329-4d1b-953c-fe5bf9768607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4df825d0-4c2d-4d2e-962b-eaa3952c6c5e', 'volume_name': 'volume-4df825d0-4c2d-4d2e-962b-eaa3952c6c5e', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d1e3b7-f4de-4647-b700-e5aa7e769395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d1e3b7-f4de-4647-b700-e5aa7e769395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37d4d82-88a3-4a41-96b3-ec3e5018870e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:53 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Volume 4df825d0-4c2d-4d2e-962b-eaa3952c6c5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4df825d0-4c2d-4d2e-962b-eaa3952c6c5e', 'volume_size': 1} Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:53 devstack sudo[86508]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d38acfde-78ec-4772-b632-b1dec4c77241 tempest-SnapshotsActionsTest-2029429911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.50db5677-3353-48fd-a84d-56fb06914e74" returned: 0 in 0.538s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:53 devstack sudo[86506]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-46d99085-e12e-4071-801e-d8a92e4d1a06 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.info" returned: 0 in 0.636s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-46d99085-e12e-4071-801e-d8a92e4d1a06 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.670s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d38acfde-78ec-4772-b632-b1dec4c77241 tempest-SnapshotsActionsTest-2029429911 None] Lock "cinder-quobyte-50db5677-3353-48fd-a84d-56fb06914e74" released by "_delete_snapshot" :: held 2.676s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.085s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-53260997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df825d0-4c2d-4d2e-962b-eaa3952c6c5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b9295d2a704f2ab265d99d0ad9ff1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:53Z,use_quota=True,user_id='a0548fa0b0114f8d9a6c4718181614c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Creating volume 4df825d0-4c2d-4d2e-962b-eaa3952c6c5e {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:30:53 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4df825d0-4c2d-4d2e-962b-eaa3952c6c5e 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:53 devstack sudo[86512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4df825d0-4c2d-4d2e-962b-eaa3952c6c5e 1073741824 Feb 27 12:30:53 devstack sudo[86512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d38acfde-78ec-4772-b632-b1dec4c77241 tempest-SnapshotsActionsTest-2029429911 None] Lock "cinder-quobyte-43f67406-a5db-4446-a1f6-919436b2057b" released by "delete_snapshot" :: held 2.734s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:53 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-46d99085-e12e-4071-801e-d8a92e4d1a06 tempest-VolumesSnapshotTestJSON-246952173 None] Create snapshot completed successfully Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-d38acfde-78ec-4772-b632-b1dec4c77241 tempest-SnapshotsActionsTest-2029429911 None] Created reservations ['a7c991e7-e38c-416f-a768-6036bcfacf24', 'ae97d3aa-3bc2-462c-aa10-f9825fa07867', '0bdf8adb-d24d-4371-8b3c-a2333ab93ffd', 'dcf03059-6f0a-4fcd-b2e6-4febe8e27a87'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:53 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-d38acfde-78ec-4772-b632-b1dec4c77241 tempest-SnapshotsActionsTest-2029429911 None] Delete snapshot completed successfully. Feb 27 12:30:53 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d38acfde-78ec-4772-b632-b1dec4c77241 tempest-SnapshotsActionsTest-2029429911 None] Lock "cinder-50db5677-3353-48fd-a84d-56fb06914e74-delete_snapshot" released by "delete_snapshot" :: held 2.834s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b5d3f756-7038-44fb-982c-fc244f810b7e tempest-SnapshotsActionsTest-949698680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:54 devstack sudo[86512]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4df825d0-4c2d-4d2e-962b-eaa3952c6c5e 1073741824" returned: 0 in 0.721s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4df825d0-4c2d-4d2e-962b-eaa3952c6c5e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:54 devstack sudo[86517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4df825d0-4c2d-4d2e-962b-eaa3952c6c5e Feb 27 12:30:54 devstack sudo[86517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:54 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:30:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Flow 'volume_create_manager' (4c99349a-44f5-4e42-8e6d-3e1f1948a957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b2dff74-ae88-45f9-b16e-a75266c5b445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b2dff74-ae88-45f9-b16e-a75266c5b445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-752322678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aeb705d-31e5-4eaa-9d78-f69806a5cfb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9efd9d3f52184a73bc3e993f4def7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=bf752d4c-ef59-43e9-abc0-46a724d2c30d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:55Z,use_quota=True,user_id='5100277d035744ff9ac8e7e06d4abd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cafab78c-5a36-429d-a7e1-a07d7de103e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cafab78c-5a36-429d-a7e1-a07d7de103e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a27323-2392-4527-9460-c2ce002d65aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a27323-2392-4527-9460-c2ce002d65aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6aeb705d-31e5-4eaa-9d78-f69806a5cfb3', 'volume_name': 'volume-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3', 'volume_size': 2, 'snapshot_id': 'bf752d4c-ef59-43e9-abc0-46a724d2c30d'}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447314b1-405e-4142-8684-689d693c82e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447314b1-405e-4142-8684-689d693c82e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab71541-ee6f-492e-89a2-a4466c76251e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:54 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Volume 6aeb705d-31e5-4eaa-9d78-f69806a5cfb3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3', 'volume_size': 2, 'snapshot_id': 'bf752d4c-ef59-43e9-abc0-46a724d2c30d'} Feb 27 12:30:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:55 devstack sudo[86517]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4df825d0-4c2d-4d2e-962b-eaa3952c6c5e" returned: 0 in 0.773s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:55 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:30:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b5d3f756-7038-44fb-982c-fc244f810b7e tempest-SnapshotsActionsTest-949698680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.883s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:55 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-b5d3f756-7038-44fb-982c-fc244f810b7e tempest-SnapshotsActionsTest-949698680 None] Creating offline snapshot 72c890cc-62c5-4cab-a180-aeaf65ca9f77 of volume 43f67406-a5db-4446-a1f6-919436b2057b {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:30:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37d4d82-88a3-4a41-96b3-ec3e5018870e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4df825d0-4c2d-4d2e-962b-eaa3952c6c5e', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed6732c-7c43-4f25-99b2-f18a13413a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:55 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c437d79a-b88b-486c-965a-72e0ee2952c7]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b5d3f756-7038-44fb-982c-fc244f810b7e tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:55 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Volume volume-4df825d0-4c2d-4d2e-962b-eaa3952c6c5e (4df825d0-4c2d-4d2e-962b-eaa3952c6c5e): created successfully Feb 27 12:30:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed6732c-7c43-4f25-99b2-f18a13413a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Flow 'volume_create_manager' (a3f57747-959b-4232-85f9-315d4675698a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:55 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-6a3bb4d9-de89-47aa-835c-f85fefed8549 tempest-VolumesServicesTestJSON-659923783 None] Created volume successfully. Feb 27 12:30:55 devstack sudo[86521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 Feb 27 12:30:55 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:55 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b5d3f756-7038-44fb-982c-fc244f810b7e tempest-SnapshotsActionsTest-949698680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1" returned: 0 in 0.665s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:55 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-b5d3f756-7038-44fb-982c-fc244f810b7e tempest-SnapshotsActionsTest-949698680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f67406-a5db-4446-a1f6-919436b2057b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:30:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b5d3f756-7038-44fb-982c-fc244f810b7e tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.72c890cc-62c5-4cab-a180-aeaf65ca9f77 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:55 devstack sudo[86527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.72c890cc-62c5-4cab-a180-aeaf65ca9f77 1G Feb 27 12:30:55 devstack sudo[86527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:55 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-e6519dff-2ecb-4ff8-a9e6-79cfe5655e2b tempest-VolumesServicesTestJSON-659923783 None] Acquiring lock "cinder-4df825d0-4c2d-4d2e-962b-eaa3952c6c5e-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:55 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-e6519dff-2ecb-4ff8-a9e6-79cfe5655e2b tempest-VolumesServicesTestJSON-659923783 None] Lock "cinder-4df825d0-4c2d-4d2e-962b-eaa3952c6c5e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:55 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-e6519dff-2ecb-4ff8-a9e6-79cfe5655e2b tempest-VolumesServicesTestJSON-659923783 None] Acquiring lock "cinder-quobyte-4df825d0-4c2d-4d2e-962b-eaa3952c6c5e" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:55 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-e6519dff-2ecb-4ff8-a9e6-79cfe5655e2b tempest-VolumesServicesTestJSON-659923783 None] Lock "cinder-quobyte-4df825d0-4c2d-4d2e-962b-eaa3952c6c5e" acquired by "delete_volume" :: waited 0.020s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:56 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b09c2c-e1f5-4dd8-a97c-ecfa9ad36d8b]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e6519dff-2ecb-4ff8-a9e6-79cfe5655e2b tempest-VolumesServicesTestJSON-659923783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4df825d0-4c2d-4d2e-962b-eaa3952c6c5e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:56 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:30:56 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Flow 'volume_create_manager' (9b380152-9d69-4c31-b68d-4c4387700f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:56 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65236e28-c6f1-4545-a1cc-7cd95b9aa597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:56 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65236e28-c6f1-4545-a1cc-7cd95b9aa597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:56Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12113f0f-f609-4278-866a-dd60fc600792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98d21bc4041b484e99e79e4968594156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:56Z,use_quota=True,user_id='4c453dd5e00b44b1ac4d34b54b3a8ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:56 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b80ef490-c2df-488e-a4ee-c4c7ed599102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:56 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b80ef490-c2df-488e-a4ee-c4c7ed599102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:56 devstack sudo[86529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4df825d0-4c2d-4d2e-962b-eaa3952c6c5e Feb 27 12:30:56 devstack sudo[86529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:56 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc4dd78-ab3a-4bee-8552-d42da0f3a1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:56 devstack cinder-volume[83077]: DEBUG cinder.image.glance [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Creating Keystone auth plugin from conf {{(pid=83077) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 12:30:56 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc4dd78-ab3a-4bee-8552-d42da0f3a1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '12113f0f-f609-4278-866a-dd60fc600792', 'volume_name': 'volume-12113f0f-f609-4278-866a-dd60fc600792', 'volume_size': 1, 'image_id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c0a1769-4e00-41fd-a047-783ef98efe34', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa6a7971cf2a477f87f22a9fc435f45d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'created_at': datetime.datetime(2026, 2, 27, 11, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 11, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c0a1769-4e00-41fd-a047-783ef98efe34/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:56 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79745834-4633-4d57-b001-ae6197e03a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:56 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79745834-4633-4d57-b001-ae6197e03a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:56 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a2c6a1-96d8-409c-b93c-ff7e4c0ffab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:56 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Volume 12113f0f-f609-4278-866a-dd60fc600792: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-12113f0f-f609-4278-866a-dd60fc600792', 'volume_size': 1, 'image_id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c0a1769-4e00-41fd-a047-783ef98efe34', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa6a7971cf2a477f87f22a9fc435f45d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'created_at': datetime.datetime(2026, 2, 27, 11, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 11, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c0a1769-4e00-41fd-a047-783ef98efe34/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 12:30:56 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Trying to clone 12113f0f-f609-4278-866a-dd60fc600792 from image 9c0a1769-4e00-41fd-a047-783ef98efe34 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9c0a1769-4e00-41fd-a047-783ef98efe34', 'metadata': {}}]). {{(pid=83077) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 12:30:56 devstack sudo[86527]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b5d3f756-7038-44fb-982c-fc244f810b7e tempest-SnapshotsActionsTest-949698680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.72c890cc-62c5-4cab-a180-aeaf65ca9f77 1G" returned: 0 in 0.851s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b5d3f756-7038-44fb-982c-fc244f810b7e tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.72c890cc-62c5-4cab-a180-aeaf65ca9f77 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:56 devstack sudo[86554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.72c890cc-62c5-4cab-a180-aeaf65ca9f77 Feb 27 12:30:56 devstack sudo[86554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:56 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_7lo5s0h4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83077) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 12:30:56 devstack cinder-volume[83077]: INFO cinder.image.image_utils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Image download 20.69 MB at 20.69 MB/s Feb 27 12:30:56 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[190937fc-740c-49d3-b339-940ccd549441]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_7lo5s0h4devstack@QuobyteHD {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:56 devstack sudo[86529]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e6519dff-2ecb-4ff8-a9e6-79cfe5655e2b tempest-VolumesServicesTestJSON-659923783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4df825d0-4c2d-4d2e-962b-eaa3952c6c5e" returned: 0 in 0.839s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e6519dff-2ecb-4ff8-a9e6-79cfe5655e2b tempest-VolumesServicesTestJSON-659923783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4df825d0-4c2d-4d2e-962b-eaa3952c6c5e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:56 devstack sudo[86561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4df825d0-4c2d-4d2e-962b-eaa3952c6c5e Feb 27 12:30:56 devstack sudo[86561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:56 devstack sudo[86560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_7lo5s0h4devstack@QuobyteHD Feb 27 12:30:56 devstack sudo[86560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:57 devstack sudo[86554]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b5d3f756-7038-44fb-982c-fc244f810b7e tempest-SnapshotsActionsTest-949698680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.72c890cc-62c5-4cab-a180-aeaf65ca9f77" returned: 0 in 0.514s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:57 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-b5d3f756-7038-44fb-982c-fc244f810b7e tempest-SnapshotsActionsTest-949698680 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.72c890cc-62c5-4cab-a180-aeaf65ca9f77 is being set with open permissions: ugo+rw Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b5d3f756-7038-44fb-982c-fc244f810b7e tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.72c890cc-62c5-4cab-a180-aeaf65ca9f77 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:57 devstack sudo[86567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.72c890cc-62c5-4cab-a180-aeaf65ca9f77 Feb 27 12:30:57 devstack sudo[86567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:57 devstack sudo[86560]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_7lo5s0h4devstack@QuobyteHD" returned: 0 in 0.519s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Temporary image 9c0a1769-4e00-41fd-a047-783ef98efe34 is fetched for user 4c453dd5e00b44b1ac4d34b54b3a8ffd. {{(pid=83077) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 12:30:57 devstack sudo[86561]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e6519dff-2ecb-4ff8-a9e6-79cfe5655e2b tempest-VolumesServicesTestJSON-659923783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4df825d0-4c2d-4d2e-962b-eaa3952c6c5e" returned: 0 in 0.509s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-e6519dff-2ecb-4ff8-a9e6-79cfe5655e2b tempest-VolumesServicesTestJSON-659923783 None] Lock "cinder-quobyte-4df825d0-4c2d-4d2e-962b-eaa3952c6c5e" released by "delete_volume" :: held 1.387s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e551388b-d2f2-4521-9355-3c747c186431]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_7lo5s0h4devstack@QuobyteHD {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-e6519dff-2ecb-4ff8-a9e6-79cfe5655e2b tempest-VolumesServicesTestJSON-659923783 None] Created reservations ['bef1f8b9-af9c-4c97-bca6-aa7bbf327f70', 'bd1053b3-dd4b-4c2e-b92b-d92f9321c333', '7ce68f5a-99d7-4acd-be19-58c9fe22d0c8', 'fb8e231c-22b8-445c-a462-abf9d9d2bb59'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-e6519dff-2ecb-4ff8-a9e6-79cfe5655e2b tempest-VolumesServicesTestJSON-659923783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-e6519dff-2ecb-4ff8-a9e6-79cfe5655e2b tempest-VolumesServicesTestJSON-659923783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-e6519dff-2ecb-4ff8-a9e6-79cfe5655e2b tempest-VolumesServicesTestJSON-659923783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-e6519dff-2ecb-4ff8-a9e6-79cfe5655e2b tempest-VolumesServicesTestJSON-659923783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-e6519dff-2ecb-4ff8-a9e6-79cfe5655e2b tempest-VolumesServicesTestJSON-659923783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e6519dff-2ecb-4ff8-a9e6-79cfe5655e2b tempest-VolumesServicesTestJSON-659923783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:57 devstack sudo[86575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:30:57 devstack sudo[86575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:57 devstack sudo[86574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_7lo5s0h4devstack@QuobyteHD Feb 27 12:30:57 devstack sudo[86574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:57 devstack sudo[86567]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b5d3f756-7038-44fb-982c-fc244f810b7e tempest-SnapshotsActionsTest-949698680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.72c890cc-62c5-4cab-a180-aeaf65ca9f77" returned: 0 in 0.638s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b5d3f756-7038-44fb-982c-fc244f810b7e tempest-SnapshotsActionsTest-949698680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.786s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.977s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "cinder-quobyte-bf752d4c-ef59-43e9-abc0-46a724d2c30d-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3" by "_create_volume_from_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-bf752d4c-ef59-43e9-abc0-46a724d2c30d-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Creating volume 6aeb705d-31e5-4eaa-9d78-f69806a5cfb3 from snapshot bf752d4c-ef59-43e9-abc0-46a724d2c30d {{(pid=83077) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "cinder-quobyte-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3" by "_copy_volume_from_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:57 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-b5d3f756-7038-44fb-982c-fc244f810b7e tempest-SnapshotsActionsTest-949698680 None] Create snapshot completed successfully Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] snapshot: bf752d4c-ef59-43e9-abc0-46a724d2c30d, volume: 6aeb705d-31e5-4eaa-9d78-f69806a5cfb3, {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1dc7e7-52c2-4fce-8443-306f908273bc]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.bf752d4c-ef59-43e9-abc0-46a724d2c30d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:58 devstack sudo[86575]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e6519dff-2ecb-4ff8-a9e6-79cfe5655e2b tempest-VolumesServicesTestJSON-659923783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.530s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-e6519dff-2ecb-4ff8-a9e6-79cfe5655e2b tempest-VolumesServicesTestJSON-659923783 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:30:58 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-e6519dff-2ecb-4ff8-a9e6-79cfe5655e2b tempest-VolumesServicesTestJSON-659923783 None] Deleted volume successfully. Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-e6519dff-2ecb-4ff8-a9e6-79cfe5655e2b tempest-VolumesServicesTestJSON-659923783 None] Lock "cinder-4df825d0-4c2d-4d2e-962b-eaa3952c6c5e-delete_volume" released by "delete_volume" :: held 2.139s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:58 devstack sudo[86580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.bf752d4c-ef59-43e9-abc0-46a724d2c30d Feb 27 12:30:58 devstack sudo[86580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:58 devstack sudo[86574]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_7lo5s0h4devstack@QuobyteHD" returned: 0 in 0.722s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b3ac4708-6d37-40d5-bbad-9e1cfed82320 tempest-SnapshotsActionsTest-2029429911 None] Acquiring lock "cinder-72c890cc-62c5-4cab-a180-aeaf65ca9f77-delete_snapshot" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b3ac4708-6d37-40d5-bbad-9e1cfed82320 tempest-SnapshotsActionsTest-2029429911 None] Lock "cinder-72c890cc-62c5-4cab-a180-aeaf65ca9f77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b3ac4708-6d37-40d5-bbad-9e1cfed82320 tempest-SnapshotsActionsTest-2029429911 None] Acquiring lock "cinder-quobyte-43f67406-a5db-4446-a1f6-919436b2057b" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b3ac4708-6d37-40d5-bbad-9e1cfed82320 tempest-SnapshotsActionsTest-2029429911 None] Lock "cinder-quobyte-43f67406-a5db-4446-a1f6-919436b2057b" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b3ac4708-6d37-40d5-bbad-9e1cfed82320 tempest-SnapshotsActionsTest-2029429911 None] Acquiring lock "cinder-quobyte-72c890cc-62c5-4cab-a180-aeaf65ca9f77" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b3ac4708-6d37-40d5-bbad-9e1cfed82320 tempest-SnapshotsActionsTest-2029429911 None] Lock "cinder-quobyte-72c890cc-62c5-4cab-a180-aeaf65ca9f77" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-b3ac4708-6d37-40d5-bbad-9e1cfed82320 tempest-SnapshotsActionsTest-2029429911 None] Deleting offline snapshot 72c890cc-62c5-4cab-a180-aeaf65ca9f77 of volume 43f67406-a5db-4446-a1f6-919436b2057b {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-b3ac4708-6d37-40d5-bbad-9e1cfed82320 tempest-SnapshotsActionsTest-2029429911 None] snapshot_file for this snap is: volume-43f67406-a5db-4446-a1f6-919436b2057b.72c890cc-62c5-4cab-a180-aeaf65ca9f77 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[df51a01e-8bcd-49b4-aafa-a935ea740791]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b3ac4708-6d37-40d5-bbad-9e1cfed82320 tempest-SnapshotsActionsTest-2029429911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.72c890cc-62c5-4cab-a180-aeaf65ca9f77 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG oslo_service.periodic_task [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83077) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:58 devstack sudo[86592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:30:58 devstack sudo[86592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:58 devstack sudo[86580]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.bf752d4c-ef59-43e9-abc0-46a724d2c30d" returned: 0 in 0.626s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Creating direct copy from snapshot {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e91937-7483-42fb-9ec0-58deb31a604d]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:58 devstack sudo[86587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.72c890cc-62c5-4cab-a180-aeaf65ca9f77 Feb 27 12:30:58 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:58 devstack sudo[86595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a Feb 27 12:30:58 devstack sudo[86595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:59 devstack sudo[86592]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.736s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:59 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:30:59 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b3ac4708-6d37-40d5-bbad-9e1cfed82320 tempest-SnapshotsActionsTest-2029429911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.72c890cc-62c5-4cab-a180-aeaf65ca9f77" returned: 0 in 0.843s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:59 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-b3ac4708-6d37-40d5-bbad-9e1cfed82320 tempest-SnapshotsActionsTest-2029429911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f67406-a5db-4446-a1f6-919436b2057b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:30:59 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0e9ace-339d-4322-b2cf-8ab5e124495e]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b3ac4708-6d37-40d5-bbad-9e1cfed82320 tempest-SnapshotsActionsTest-2029429911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:59 devstack sudo[86622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 Feb 27 12:30:59 devstack sudo[86622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:59 devstack sudo[86595]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a" returned: 0 in 0.980s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:59 devstack cinder-volume[83077]: DEBUG cinder.utils [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Path /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3 not found in is_blk_device check {{(pid=83077) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 12:30:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:59 devstack sudo[86627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3 Feb 27 12:30:59 devstack sudo[86627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:00 devstack sudo[86622]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b3ac4708-6d37-40d5-bbad-9e1cfed82320 tempest-SnapshotsActionsTest-2029429911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1" returned: 0 in 0.750s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:00 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-b3ac4708-6d37-40d5-bbad-9e1cfed82320 tempest-SnapshotsActionsTest-2029429911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f67406-a5db-4446-a1f6-919436b2057b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:31:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b3ac4708-6d37-40d5-bbad-9e1cfed82320 tempest-SnapshotsActionsTest-2029429911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.72c890cc-62c5-4cab-a180-aeaf65ca9f77 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:00 devstack sudo[86635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.72c890cc-62c5-4cab-a180-aeaf65ca9f77 Feb 27 12:31:00 devstack sudo[86635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:01 devstack sudo[86635]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b3ac4708-6d37-40d5-bbad-9e1cfed82320 tempest-SnapshotsActionsTest-2029429911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.72c890cc-62c5-4cab-a180-aeaf65ca9f77" returned: 0 in 1.349s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b3ac4708-6d37-40d5-bbad-9e1cfed82320 tempest-SnapshotsActionsTest-2029429911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.72c890cc-62c5-4cab-a180-aeaf65ca9f77 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:01 devstack sudo[86649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.72c890cc-62c5-4cab-a180-aeaf65ca9f77 Feb 27 12:31:01 devstack sudo[86649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:02 devstack sudo[86627]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3" returned: 0 in 3.183s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:02 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69aa331-257c-4ab2-bb16-f0fd0c0282fe]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:02 devstack sudo[86649]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:02 devstack sudo[86652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a Feb 27 12:31:02 devstack sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b3ac4708-6d37-40d5-bbad-9e1cfed82320 tempest-SnapshotsActionsTest-2029429911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.72c890cc-62c5-4cab-a180-aeaf65ca9f77" returned: 0 in 1.425s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:02 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b3ac4708-6d37-40d5-bbad-9e1cfed82320 tempest-SnapshotsActionsTest-2029429911 None] Lock "cinder-quobyte-72c890cc-62c5-4cab-a180-aeaf65ca9f77" released by "_delete_snapshot" :: held 4.431s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:02 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b3ac4708-6d37-40d5-bbad-9e1cfed82320 tempest-SnapshotsActionsTest-2029429911 None] Lock "cinder-quobyte-43f67406-a5db-4446-a1f6-919436b2057b" released by "delete_snapshot" :: held 4.446s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:02 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-b3ac4708-6d37-40d5-bbad-9e1cfed82320 tempest-SnapshotsActionsTest-2029429911 None] Created reservations ['1e5142e2-b553-4aa1-af76-88fc0027b458', '10220a24-effa-4b68-a8bf-319d34aaa309', '8a353ad8-57a5-45be-a379-5c270597427d', '93bdbe2c-b474-44f8-a122-b03ab6d6c81b'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:03 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-b3ac4708-6d37-40d5-bbad-9e1cfed82320 tempest-SnapshotsActionsTest-2029429911 None] Delete snapshot completed successfully. Feb 27 12:31:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b3ac4708-6d37-40d5-bbad-9e1cfed82320 tempest-SnapshotsActionsTest-2029429911 None] Lock "cinder-72c890cc-62c5-4cab-a180-aeaf65ca9f77-delete_snapshot" released by "delete_snapshot" :: held 4.559s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:03 devstack sudo[86652]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a" returned: 0 in 0.684s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:03 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Image conversion details: src /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a, size 1024.00 MB, duration 3.18 sec, destination /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3 {{(pid=83077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:31:03 devstack cinder-volume[83077]: INFO cinder.image.image_utils [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Converted 1024.00 MB image at 321.56 MB/s Feb 27 12:31:03 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3 is being set with open permissions: ugo+rw Feb 27 12:31:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:03 devstack sudo[86657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3 Feb 27 12:31:03 devstack sudo[86657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:04 devstack sudo[86657]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3" returned: 0 in 0.558s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3" released by "_copy_volume_from_snapshot" :: held 6.109s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-bf752d4c-ef59-43e9-abc0-46a724d2c30d-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3" released by "_create_volume_from_snapshot" :: held 6.152s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.195s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.905s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:56Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12113f0f-f609-4278-866a-dd60fc600792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98d21bc4041b484e99e79e4968594156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:56Z,use_quota=True,user_id='4c453dd5e00b44b1ac4d34b54b3a8ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Creating volume 12113f0f-f609-4278-866a-dd60fc600792 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:31:04 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:04 devstack sudo[86660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792 1073741824 Feb 27 12:31:04 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab71541-ee6f-492e-89a2-a4466c76251e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3', 'volume_size': 2, 'snapshot_id': 'bf752d4c-ef59-43e9-abc0-46a724d2c30d'}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cdd65dd-ac10-4367-ac0b-56f9e1567799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:04 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Volume volume-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3 (6aeb705d-31e5-4eaa-9d78-f69806a5cfb3): created successfully Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cdd65dd-ac10-4367-ac0b-56f9e1567799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Flow 'volume_create_manager' (4c99349a-44f5-4e42-8e6d-3e1f1948a957) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5b9a3c10-c2d6-4580-86b6-a024e09d036c tempest-SnapshotsActionsTest-949698680 None] Acquiring lock "cinder-69485911-ec8c-468c-a6d2-9500123458f1-delete_snapshot" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5b9a3c10-c2d6-4580-86b6-a024e09d036c tempest-SnapshotsActionsTest-949698680 None] Lock "cinder-69485911-ec8c-468c-a6d2-9500123458f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5b9a3c10-c2d6-4580-86b6-a024e09d036c tempest-SnapshotsActionsTest-949698680 None] Acquiring lock "cinder-quobyte-43f67406-a5db-4446-a1f6-919436b2057b" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:04 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-af466a6b-f987-4e12-b233-6ace19ab6920 tempest-VolumesSnapshotTestJSON-246952173 None] Created volume successfully. Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5b9a3c10-c2d6-4580-86b6-a024e09d036c tempest-SnapshotsActionsTest-949698680 None] Lock "cinder-quobyte-43f67406-a5db-4446-a1f6-919436b2057b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5b9a3c10-c2d6-4580-86b6-a024e09d036c tempest-SnapshotsActionsTest-949698680 None] Acquiring lock "cinder-quobyte-69485911-ec8c-468c-a6d2-9500123458f1" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5b9a3c10-c2d6-4580-86b6-a024e09d036c tempest-SnapshotsActionsTest-949698680 None] Lock "cinder-quobyte-69485911-ec8c-468c-a6d2-9500123458f1" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-5b9a3c10-c2d6-4580-86b6-a024e09d036c tempest-SnapshotsActionsTest-949698680 None] Deleting offline snapshot 69485911-ec8c-468c-a6d2-9500123458f1 of volume 43f67406-a5db-4446-a1f6-919436b2057b {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-5b9a3c10-c2d6-4580-86b6-a024e09d036c tempest-SnapshotsActionsTest-949698680 None] snapshot_file for this snap is: volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[893f15b1-6ad6-41de-8b84-88ba436c6e8c]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5b9a3c10-c2d6-4580-86b6-a024e09d036c tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:04 devstack sudo[86662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 Feb 27 12:31:04 devstack sudo[86662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:04 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792 1073741824" returned: 0 in 0.625s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:04 devstack sudo[86669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792 Feb 27 12:31:04 devstack sudo[86669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:04 devstack sudo[86662]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5b9a3c10-c2d6-4580-86b6-a024e09d036c tempest-SnapshotsActionsTest-949698680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1" returned: 0 in 0.721s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-5b9a3c10-c2d6-4580-86b6-a024e09d036c tempest-SnapshotsActionsTest-949698680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f67406-a5db-4446-a1f6-919436b2057b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:31:05 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a9e521ab-eaf0-4c29-8ea6-533a0a5bb4ed tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "cinder-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:05 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d5b74f-8a49-49ad-8460-d4d2702876ac]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5b9a3c10-c2d6-4580-86b6-a024e09d036c tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:05 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a9e521ab-eaf0-4c29-8ea6-533a0a5bb4ed tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:05 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a9e521ab-eaf0-4c29-8ea6-533a0a5bb4ed tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "cinder-quobyte-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:05 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a9e521ab-eaf0-4c29-8ea6-533a0a5bb4ed tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3" acquired by "delete_volume" :: waited 0.017s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:05 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8203568-56c6-4cf9-8106-eb82e63c5a8c]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a9e521ab-eaf0-4c29-8ea6-533a0a5bb4ed tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:05 devstack sudo[86673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b Feb 27 12:31:05 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:05 devstack sudo[86674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3 Feb 27 12:31:05 devstack sudo[86674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:05 devstack sudo[86669]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792" returned: 0 in 0.742s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:05 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:31:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:05 devstack cinder-volume[83077]: DEBUG cinder.volume.volume_utils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Attempting download of 9c0a1769-4e00-41fd-a047-783ef98efe34 ((None, [{'url': 'file:///opt/stack/data/glance/images/9c0a1769-4e00-41fd-a047-783ef98efe34', 'metadata': {}}])) to volume 12113f0f-f609-4278-866a-dd60fc600792. {{(pid=83077) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 12:31:05 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e786a23f-a278-4f0a-8149-7c5e3bdf202e]: (4, 'raw') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_3cn8an4k {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:05 devstack sudo[86678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_3cn8an4k Feb 27 12:31:05 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:05 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5b9a3c10-c2d6-4580-86b6-a024e09d036c tempest-SnapshotsActionsTest-949698680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b" returned: 0 in 0.862s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5b9a3c10-c2d6-4580-86b6-a024e09d036c tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:05 devstack sudo[86683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 Feb 27 12:31:05 devstack sudo[86683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:06 devstack sudo[86674]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a9e521ab-eaf0-4c29-8ea6-533a0a5bb4ed tempest-VolumesSnapshotTestJSON-246952173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3" returned: 0 in 0.928s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a9e521ab-eaf0-4c29-8ea6-533a0a5bb4ed tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:06 devstack sudo[86688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3 Feb 27 12:31:06 devstack sudo[86688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:06 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_3cn8an4k" returned: 0 in 0.983s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_3cn8an4k {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:06 devstack sudo[86692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_3cn8an4k Feb 27 12:31:06 devstack sudo[86692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:06 devstack sudo[86688]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a9e521ab-eaf0-4c29-8ea6-533a0a5bb4ed tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3" returned: 0 in 0.618s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:06 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a9e521ab-eaf0-4c29-8ea6-533a0a5bb4ed tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3" released by "delete_volume" :: held 1.576s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:06 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-a9e521ab-eaf0-4c29-8ea6-533a0a5bb4ed tempest-VolumesSnapshotTestJSON-246952173 None] Created reservations ['4b200831-e259-407c-959b-9cef78098a9c', 'a4ce7b14-cd43-4b9a-b316-e51654c1bd14', '15ca843a-be45-42df-b40e-ea8ddbee8e30', 'b0c60bd5-95a4-406b-842f-0dd815730e60'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a9e521ab-eaf0-4c29-8ea6-533a0a5bb4ed tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a9e521ab-eaf0-4c29-8ea6-533a0a5bb4ed tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:06 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a9e521ab-eaf0-4c29-8ea6-533a0a5bb4ed tempest-VolumesSnapshotTestJSON-246952173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:06 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a9e521ab-eaf0-4c29-8ea6-533a0a5bb4ed tempest-VolumesSnapshotTestJSON-246952173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a9e521ab-eaf0-4c29-8ea6-533a0a5bb4ed tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a9e521ab-eaf0-4c29-8ea6-533a0a5bb4ed tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:06 devstack sudo[86698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:31:06 devstack sudo[86698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:06 devstack sudo[86683]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5b9a3c10-c2d6-4580-86b6-a024e09d036c tempest-SnapshotsActionsTest-949698680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1" returned: 0 in 1.017s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5b9a3c10-c2d6-4580-86b6-a024e09d036c tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:06 devstack sudo[86700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1 Feb 27 12:31:06 devstack sudo[86700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:07 devstack sudo[86692]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_3cn8an4k" returned: 1 in 0.664s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_3cn8an4k' failed. Not Retrying. {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:31:07 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5f4ff4-a0c9-4522-bf46-e83397446fc0]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_7lo5s0h4devstack@QuobyteHD {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-2c8879a2-dbb2-4019-8bfe-c5a18c092d95 tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "cinder-bf752d4c-ef59-43e9-abc0-46a724d2c30d-delete_snapshot" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-2c8879a2-dbb2-4019-8bfe-c5a18c092d95 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-bf752d4c-ef59-43e9-abc0-46a724d2c30d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-2c8879a2-dbb2-4019-8bfe-c5a18c092d95 tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "cinder-quobyte-52a8516a-4dd5-4568-a2c5-97bd65bc949a" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-2c8879a2-dbb2-4019-8bfe-c5a18c092d95 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-52a8516a-4dd5-4568-a2c5-97bd65bc949a" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-2c8879a2-dbb2-4019-8bfe-c5a18c092d95 tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "cinder-quobyte-bf752d4c-ef59-43e9-abc0-46a724d2c30d" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-2c8879a2-dbb2-4019-8bfe-c5a18c092d95 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-bf752d4c-ef59-43e9-abc0-46a724d2c30d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:07 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-2c8879a2-dbb2-4019-8bfe-c5a18c092d95 tempest-VolumesSnapshotTestJSON-246952173 None] Deleting offline snapshot bf752d4c-ef59-43e9-abc0-46a724d2c30d of volume 52a8516a-4dd5-4568-a2c5-97bd65bc949a {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:31:07 devstack sudo[86704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_7lo5s0h4devstack@QuobyteHD Feb 27 12:31:07 devstack sudo[86704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:07 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-2c8879a2-dbb2-4019-8bfe-c5a18c092d95 tempest-VolumesSnapshotTestJSON-246952173 None] snapshot_file for this snap is: volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.bf752d4c-ef59-43e9-abc0-46a724d2c30d {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:31:07 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18a3bd7-d2bb-478b-a4e1-b96d9bcf6a98]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2c8879a2-dbb2-4019-8bfe-c5a18c092d95 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.bf752d4c-ef59-43e9-abc0-46a724d2c30d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:07 devstack sudo[86700]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5b9a3c10-c2d6-4580-86b6-a024e09d036c tempest-SnapshotsActionsTest-949698680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b.69485911-ec8c-468c-a6d2-9500123458f1" returned: 0 in 0.666s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5b9a3c10-c2d6-4580-86b6-a024e09d036c tempest-SnapshotsActionsTest-949698680 None] Lock "cinder-quobyte-69485911-ec8c-468c-a6d2-9500123458f1" released by "_delete_snapshot" :: held 3.365s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5b9a3c10-c2d6-4580-86b6-a024e09d036c tempest-SnapshotsActionsTest-949698680 None] Lock "cinder-quobyte-43f67406-a5db-4446-a1f6-919436b2057b" released by "delete_snapshot" :: held 3.381s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:07 devstack sudo[86698]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a9e521ab-eaf0-4c29-8ea6-533a0a5bb4ed tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.838s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:07 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-a9e521ab-eaf0-4c29-8ea6-533a0a5bb4ed tempest-VolumesSnapshotTestJSON-246952173 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:31:07 devstack sudo[86707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.bf752d4c-ef59-43e9-abc0-46a724d2c30d Feb 27 12:31:07 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-a9e521ab-eaf0-4c29-8ea6-533a0a5bb4ed tempest-VolumesSnapshotTestJSON-246952173 None] Deleted volume successfully. Feb 27 12:31:07 devstack sudo[86707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:07 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-5b9a3c10-c2d6-4580-86b6-a024e09d036c tempest-SnapshotsActionsTest-949698680 None] Created reservations ['bbeed6f0-6a30-4090-8c84-f3f31141bcd0', '5f0a7baa-6eef-4111-9ba3-5078e8de8268', 'c93e9c31-e2df-4ec1-989a-ea62e5e9406f', '44351683-83f8-4777-b4ad-aae6802abbc8'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a9e521ab-eaf0-4c29-8ea6-533a0a5bb4ed tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-6aeb705d-31e5-4eaa-9d78-f69806a5cfb3-delete_volume" released by "delete_volume" :: held 2.662s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:07 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-5b9a3c10-c2d6-4580-86b6-a024e09d036c tempest-SnapshotsActionsTest-949698680 None] Delete snapshot completed successfully. Feb 27 12:31:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5b9a3c10-c2d6-4580-86b6-a024e09d036c tempest-SnapshotsActionsTest-949698680 None] Lock "cinder-69485911-ec8c-468c-a6d2-9500123458f1-delete_snapshot" released by "delete_snapshot" :: held 3.559s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Flow 'volume_create_manager' (4755f4c1-2ec2-400f-a33a-5c424500bcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (327e7689-eed6-4066-ae50-3af7f30cbc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (327e7689-eed6-4066-ae50-3af7f30cbc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-707202341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bc6b8b1-7751-4070-89c5-3cbf9d6c694b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c6664c7d0644e9783555150aaceb2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:08Z,use_quota=True,user_id='9688ae523adf44b6ad90b515cba978da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e6a187-fff8-4486-a505-b14b23552488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e6a187-fff8-4486-a505-b14b23552488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e05e145-39bb-4571-91be-b190a9668b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e05e145-39bb-4571-91be-b190a9668b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bc6b8b1-7751-4070-89c5-3cbf9d6c694b', 'volume_name': 'volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c12af79f-c39e-499c-8aa6-bfe218cdfcb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:08 devstack sudo[86704]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c12af79f-c39e-499c-8aa6-bfe218cdfcb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7306f83e-f240-4657-9179-bb280df25f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:08 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Volume 6bc6b8b1-7751-4070-89c5-3cbf9d6c694b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b', 'volume_size': 1} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-707202341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bc6b8b1-7751-4070-89c5-3cbf9d6c694b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c6664c7d0644e9783555150aaceb2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:08Z,use_quota=True,user_id='9688ae523adf44b6ad90b515cba978da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Creating volume 6bc6b8b1-7751-4070-89c5-3cbf9d6c694b {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:31:08 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_7lo5s0h4devstack@QuobyteHD" returned: 0 in 0.964s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] 9c0a1769-4e00-41fd-a047-783ef98efe34 was qcow2, converting to raw {{(pid=83077) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_7lo5s0h4devstack@QuobyteHD /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:08 devstack sudo[86713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b 1073741824 Feb 27 12:31:08 devstack sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:08 devstack sudo[86714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_7lo5s0h4devstack@QuobyteHD /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792 Feb 27 12:31:08 devstack sudo[86714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:08 devstack sudo[86707]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2c8879a2-dbb2-4019-8bfe-c5a18c092d95 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.bf752d4c-ef59-43e9-abc0-46a724d2c30d" returned: 0 in 0.802s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-2c8879a2-dbb2-4019-8bfe-c5a18c092d95 tempest-VolumesSnapshotTestJSON-246952173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f5f422-caa2-4946-bf5e-6b8ab1a96c9b]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2c8879a2-dbb2-4019-8bfe-c5a18c092d95 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:08 devstack sudo[86720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a Feb 27 12:31:08 devstack sudo[86720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b00ebed3-e785-4f47-ae45-58b0b8c7051f tempest-SnapshotsActionsTest-949698680 None] Acquiring lock "cinder-43f67406-a5db-4446-a1f6-919436b2057b-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b00ebed3-e785-4f47-ae45-58b0b8c7051f tempest-SnapshotsActionsTest-949698680 None] Lock "cinder-43f67406-a5db-4446-a1f6-919436b2057b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b00ebed3-e785-4f47-ae45-58b0b8c7051f tempest-SnapshotsActionsTest-949698680 None] Acquiring lock "cinder-quobyte-43f67406-a5db-4446-a1f6-919436b2057b" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b00ebed3-e785-4f47-ae45-58b0b8c7051f tempest-SnapshotsActionsTest-949698680 None] Lock "cinder-quobyte-43f67406-a5db-4446-a1f6-919436b2057b" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35d0503-93ed-4945-9c27-a8f3a4480581]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b00ebed3-e785-4f47-ae45-58b0b8c7051f tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:08 devstack sudo[86722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b Feb 27 12:31:08 devstack sudo[86722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:08 devstack sudo[86713]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b 1073741824" returned: 0 in 0.706s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:08 devstack sudo[86720]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2c8879a2-dbb2-4019-8bfe-c5a18c092d95 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a" returned: 0 in 0.609s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2c8879a2-dbb2-4019-8bfe-c5a18c092d95 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.bf752d4c-ef59-43e9-abc0-46a724d2c30d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:08 devstack sudo[86735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b Feb 27 12:31:08 devstack sudo[86735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:08 devstack sudo[86736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.bf752d4c-ef59-43e9-abc0-46a724d2c30d Feb 27 12:31:08 devstack sudo[86736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:09 devstack sudo[86714]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_7lo5s0h4devstack@QuobyteHD /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792" returned: 0 in 1.178s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:09 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_7lo5s0h4devstack@QuobyteHD, size 112.00 MB, duration 1.18 sec, destination /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792 {{(pid=83077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:31:09 devstack cinder-volume[83077]: INFO cinder.image.image_utils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Converted 112.00 MB image at 95.01 MB/s Feb 27 12:31:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:09 devstack sudo[86742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792 1G Feb 27 12:31:09 devstack sudo[86742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:09 devstack sudo[86722]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b00ebed3-e785-4f47-ae45-58b0b8c7051f tempest-SnapshotsActionsTest-949698680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b" returned: 0 in 0.868s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b00ebed3-e785-4f47-ae45-58b0b8c7051f tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:09 devstack sudo[86747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b Feb 27 12:31:09 devstack sudo[86747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:09 devstack sudo[86735]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b" returned: 0 in 0.651s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:09 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:31:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7306f83e-f240-4657-9179-bb280df25f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d73161b4-f917-4b67-83f5-2f3ac04de40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:09 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Volume volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b (6bc6b8b1-7751-4070-89c5-3cbf9d6c694b): created successfully Feb 27 12:31:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d73161b4-f917-4b67-83f5-2f3ac04de40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Flow 'volume_create_manager' (4755f4c1-2ec2-400f-a33a-5c424500bcc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:09 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-6d2f1347-bc75-4e8d-bce0-fc5bbb04a655 tempest-SnapshotMetadataTestJSON-930836664 None] Created volume successfully. Feb 27 12:31:09 devstack sudo[86736]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2c8879a2-dbb2-4019-8bfe-c5a18c092d95 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.bf752d4c-ef59-43e9-abc0-46a724d2c30d" returned: 0 in 0.729s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2c8879a2-dbb2-4019-8bfe-c5a18c092d95 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.bf752d4c-ef59-43e9-abc0-46a724d2c30d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:09 devstack sudo[86750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.bf752d4c-ef59-43e9-abc0-46a724d2c30d Feb 27 12:31:09 devstack sudo[86750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:09 devstack sudo[86742]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792 1G" returned: 0 in 0.534s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:09 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6d1f3a-f941-468b-8985-72b89dfa8d55]: (4, 'raw') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:09 devstack sudo[86747]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b00ebed3-e785-4f47-ae45-58b0b8c7051f tempest-SnapshotsActionsTest-949698680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-43f67406-a5db-4446-a1f6-919436b2057b" returned: 0 in 0.478s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:09 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b00ebed3-e785-4f47-ae45-58b0b8c7051f tempest-SnapshotsActionsTest-949698680 None] Lock "cinder-quobyte-43f67406-a5db-4446-a1f6-919436b2057b" released by "delete_volume" :: held 1.391s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:09 devstack cinder-volume[83077]: DEBUG dbcounter [-] [83077] Writing DB stats cinder:SELECT=137,cinder:UPDATE=151,cinder:INSERT=40,cinder:DELETE=13 {{(pid=83077) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:31:09 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-b00ebed3-e785-4f47-ae45-58b0b8c7051f tempest-SnapshotsActionsTest-949698680 None] Created reservations ['35c217aa-1264-4b12-b93d-69148dbc9217', '0520a4f0-7a4d-48dc-b429-0257fc21df35', 'e8111de7-9930-4f6e-b398-64c9792cac1d', 'dc799b38-bed1-4e8e-bbd5-163983926ceb'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b00ebed3-e785-4f47-ae45-58b0b8c7051f tempest-SnapshotsActionsTest-949698680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b00ebed3-e785-4f47-ae45-58b0b8c7051f tempest-SnapshotsActionsTest-949698680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:09 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b00ebed3-e785-4f47-ae45-58b0b8c7051f tempest-SnapshotsActionsTest-949698680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:09 devstack sudo[86756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792 Feb 27 12:31:09 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b00ebed3-e785-4f47-ae45-58b0b8c7051f tempest-SnapshotsActionsTest-949698680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b00ebed3-e785-4f47-ae45-58b0b8c7051f tempest-SnapshotsActionsTest-949698680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:09 devstack sudo[86756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b00ebed3-e785-4f47-ae45-58b0b8c7051f tempest-SnapshotsActionsTest-949698680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:10 devstack sudo[86759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:31:10 devstack sudo[86759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:10 devstack sudo[86750]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2c8879a2-dbb2-4019-8bfe-c5a18c092d95 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a.bf752d4c-ef59-43e9-abc0-46a724d2c30d" returned: 0 in 0.446s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-2c8879a2-dbb2-4019-8bfe-c5a18c092d95 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-bf752d4c-ef59-43e9-abc0-46a724d2c30d" released by "_delete_snapshot" :: held 2.649s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-2c8879a2-dbb2-4019-8bfe-c5a18c092d95 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-52a8516a-4dd5-4568-a2c5-97bd65bc949a" released by "delete_snapshot" :: held 2.670s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:10 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-2c8879a2-dbb2-4019-8bfe-c5a18c092d95 tempest-VolumesSnapshotTestJSON-246952173 None] Created reservations ['52c60918-a522-4b38-85c2-30c2053d12b2', '2663e665-07cf-4f35-b126-728184a88275', '7b16f2f1-cdbf-4634-97a8-27a1823227fc', '40b78958-44fd-4002-8143-ba46e41175b6'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:10 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-2c8879a2-dbb2-4019-8bfe-c5a18c092d95 tempest-VolumesSnapshotTestJSON-246952173 None] Delete snapshot completed successfully. Feb 27 12:31:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-2c8879a2-dbb2-4019-8bfe-c5a18c092d95 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-bf752d4c-ef59-43e9-abc0-46a724d2c30d-delete_snapshot" released by "delete_snapshot" :: held 2.789s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-92fea564-de1f-4cd6-925d-aa46e0b5b495 tempest-SnapshotMetadataTestJSON-930836664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-92fea564-de1f-4cd6-925d-aa46e0b5b495 tempest-SnapshotMetadataTestJSON-930836664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:10 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-92fea564-de1f-4cd6-925d-aa46e0b5b495 tempest-SnapshotMetadataTestJSON-930836664 None] Creating offline snapshot d2faa1a7-d5a1-494c-8451-474166c44aa2 of volume 6bc6b8b1-7751-4070-89c5-3cbf9d6c694b {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:31:10 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2015a88-3df1-406f-b199-783b7ddbf8a1]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-92fea564-de1f-4cd6-925d-aa46e0b5b495 tempest-SnapshotMetadataTestJSON-930836664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:10 devstack sudo[86759]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b00ebed3-e785-4f47-ae45-58b0b8c7051f tempest-SnapshotsActionsTest-949698680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.469s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:10 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-b00ebed3-e785-4f47-ae45-58b0b8c7051f tempest-SnapshotsActionsTest-949698680 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:31:10 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-b00ebed3-e785-4f47-ae45-58b0b8c7051f tempest-SnapshotsActionsTest-949698680 None] Deleted volume successfully. Feb 27 12:31:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b00ebed3-e785-4f47-ae45-58b0b8c7051f tempest-SnapshotsActionsTest-949698680 None] Lock "cinder-43f67406-a5db-4446-a1f6-919436b2057b-delete_volume" released by "delete_volume" :: held 2.016s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:10 devstack sudo[86763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b Feb 27 12:31:10 devstack sudo[86763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:10 devstack sudo[86756]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792" returned: 0 in 0.620s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:10 devstack sudo[86766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792 Feb 27 12:31:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-df279518-7dbf-4c0b-bd96-aa0893c57a3c tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "cinder-52a8516a-4dd5-4568-a2c5-97bd65bc949a-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:10 devstack sudo[86766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-df279518-7dbf-4c0b-bd96-aa0893c57a3c tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-52a8516a-4dd5-4568-a2c5-97bd65bc949a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-df279518-7dbf-4c0b-bd96-aa0893c57a3c tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "cinder-quobyte-52a8516a-4dd5-4568-a2c5-97bd65bc949a" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-df279518-7dbf-4c0b-bd96-aa0893c57a3c tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-52a8516a-4dd5-4568-a2c5-97bd65bc949a" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:10 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3789ca5-4d4b-4085-a494-37dcc952ea87]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-df279518-7dbf-4c0b-bd96-aa0893c57a3c tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:10 devstack sudo[86768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a Feb 27 12:31:10 devstack sudo[86768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:10 devstack sudo[86763]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-92fea564-de1f-4cd6-925d-aa46e0b5b495 tempest-SnapshotMetadataTestJSON-930836664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b" returned: 0 in 0.547s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-92fea564-de1f-4cd6-925d-aa46e0b5b495 tempest-SnapshotMetadataTestJSON-930836664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b.d2faa1a7-d5a1-494c-8451-474166c44aa2 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:10 devstack sudo[86777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b.d2faa1a7-d5a1-494c-8451-474166c44aa2 1G Feb 27 12:31:10 devstack sudo[86777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:10 devstack sudo[86766]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792" returned: 1 in 0.496s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792' failed. Not Retrying. {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:31:10 devstack cinder-volume[83077]: DEBUG cinder.volume.volume_utils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Downloaded image 9c0a1769-4e00-41fd-a047-783ef98efe34 ((None, [{'url': 'file:///opt/stack/data/glance/images/9c0a1769-4e00-41fd-a047-783ef98efe34', 'metadata': {}}])) to volume 12113f0f-f609-4278-866a-dd60fc600792 successfully. {{(pid=83077) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 12:31:11 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Temporary image 9c0a1769-4e00-41fd-a047-783ef98efe34 for user 4c453dd5e00b44b1ac4d34b54b3a8ffd is deleted. {{(pid=83077) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 12:31:11 devstack cinder-volume[83077]: DEBUG cinder.volume.volume_utils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Marking volume 12113f0f-f609-4278-866a-dd60fc600792 as bootable. {{(pid=83077) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 12:31:11 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Copying metadata from image 9c0a1769-4e00-41fd-a047-783ef98efe34 to 12113f0f-f609-4278-866a-dd60fc600792. {{(pid=83077) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 12:31:11 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Creating volume glance metadata for volume 12113f0f-f609-4278-866a-dd60fc600792 backed by image 9c0a1769-4e00-41fd-a047-783ef98efe34 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83077) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 12:31:11 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a2c6a1-96d8-409c-b93c-ff7e4c0ffab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12113f0f-f609-4278-866a-dd60fc600792', 'volume_size': 1, 'image_id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c0a1769-4e00-41fd-a047-783ef98efe34', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa6a7971cf2a477f87f22a9fc435f45d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'created_at': datetime.datetime(2026, 2, 27, 11, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 11, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c0a1769-4e00-41fd-a047-783ef98efe34/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:11 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf74edd9-b34f-44a6-bd6c-7c9745fe828a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:11 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Volume volume-12113f0f-f609-4278-866a-dd60fc600792 (12113f0f-f609-4278-866a-dd60fc600792): created successfully Feb 27 12:31:11 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf74edd9-b34f-44a6-bd6c-7c9745fe828a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:11 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Flow 'volume_create_manager' (9b380152-9d69-4c31-b68d-4c4387700f25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:11 devstack cinder-volume[83077]: INFO cinder.volume.manager [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-68d2c877-6c19-42d7-a212-c6f4125a3fb6 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Created volume successfully. Feb 27 12:31:11 devstack sudo[86768]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-df279518-7dbf-4c0b-bd96-aa0893c57a3c tempest-VolumesSnapshotTestJSON-246952173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a" returned: 0 in 0.535s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-df279518-7dbf-4c0b-bd96-aa0893c57a3c tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:11 devstack sudo[86782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a Feb 27 12:31:11 devstack sudo[86782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:11 devstack sudo[86777]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-92fea564-de1f-4cd6-925d-aa46e0b5b495 tempest-SnapshotMetadataTestJSON-930836664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b.d2faa1a7-d5a1-494c-8451-474166c44aa2 1G" returned: 0 in 0.569s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-92fea564-de1f-4cd6-925d-aa46e0b5b495 tempest-SnapshotMetadataTestJSON-930836664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b.d2faa1a7-d5a1-494c-8451-474166c44aa2 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:11 devstack sudo[86787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b.d2faa1a7-d5a1-494c-8451-474166c44aa2 Feb 27 12:31:11 devstack sudo[86787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:11 devstack sudo[86782]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-df279518-7dbf-4c0b-bd96-aa0893c57a3c tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-52a8516a-4dd5-4568-a2c5-97bd65bc949a" returned: 0 in 0.509s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:11 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-df279518-7dbf-4c0b-bd96-aa0893c57a3c tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-52a8516a-4dd5-4568-a2c5-97bd65bc949a" released by "delete_volume" :: held 1.077s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:11 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-df279518-7dbf-4c0b-bd96-aa0893c57a3c tempest-VolumesSnapshotTestJSON-246952173 None] Created reservations ['f64058a3-d684-48e4-8bd6-5a4ef2d3cdb7', '1c78b917-0b5f-4bc1-9d6d-0b7363c67654', 'c408cb3d-ce57-49bd-882f-46b956b9916e', '96bc8d2f-533b-4be9-b3a1-feb360670a1b'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-df279518-7dbf-4c0b-bd96-aa0893c57a3c tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-df279518-7dbf-4c0b-bd96-aa0893c57a3c tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:11 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-df279518-7dbf-4c0b-bd96-aa0893c57a3c tempest-VolumesSnapshotTestJSON-246952173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:11 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-df279518-7dbf-4c0b-bd96-aa0893c57a3c tempest-VolumesSnapshotTestJSON-246952173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-df279518-7dbf-4c0b-bd96-aa0893c57a3c tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-df279518-7dbf-4c0b-bd96-aa0893c57a3c tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:11 devstack sudo[86790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:31:11 devstack sudo[86790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:12 devstack sudo[86787]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-92fea564-de1f-4cd6-925d-aa46e0b5b495 tempest-SnapshotMetadataTestJSON-930836664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b.d2faa1a7-d5a1-494c-8451-474166c44aa2" returned: 0 in 0.552s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:12 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-92fea564-de1f-4cd6-925d-aa46e0b5b495 tempest-SnapshotMetadataTestJSON-930836664 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b.d2faa1a7-d5a1-494c-8451-474166c44aa2 is being set with open permissions: ugo+rw Feb 27 12:31:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-92fea564-de1f-4cd6-925d-aa46e0b5b495 tempest-SnapshotMetadataTestJSON-930836664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b.d2faa1a7-d5a1-494c-8451-474166c44aa2 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-43501a3d-0fb7-4d87-ad7a-74ee8b25e543 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:12 devstack sudo[86803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b.d2faa1a7-d5a1-494c-8451-474166c44aa2 Feb 27 12:31:12 devstack sudo[86803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:12 devstack sudo[86790]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-df279518-7dbf-4c0b-bd96-aa0893c57a3c tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.473s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:12 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-df279518-7dbf-4c0b-bd96-aa0893c57a3c tempest-VolumesSnapshotTestJSON-246952173 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:31:12 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-df279518-7dbf-4c0b-bd96-aa0893c57a3c tempest-VolumesSnapshotTestJSON-246952173 None] Deleted volume successfully. Feb 27 12:31:12 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-df279518-7dbf-4c0b-bd96-aa0893c57a3c tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-52a8516a-4dd5-4568-a2c5-97bd65bc949a-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:12 devstack sudo[86803]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-92fea564-de1f-4cd6-925d-aa46e0b5b495 tempest-SnapshotMetadataTestJSON-930836664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b.d2faa1a7-d5a1-494c-8451-474166c44aa2" returned: 0 in 0.441s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-92fea564-de1f-4cd6-925d-aa46e0b5b495 tempest-SnapshotMetadataTestJSON-930836664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:12 devstack sudo[86807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b.info Feb 27 12:31:12 devstack sudo[86807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:13 devstack sudo[86807]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-92fea564-de1f-4cd6-925d-aa46e0b5b495 tempest-SnapshotMetadataTestJSON-930836664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b.info" returned: 0 in 0.498s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:13 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-92fea564-de1f-4cd6-925d-aa46e0b5b495 tempest-SnapshotMetadataTestJSON-930836664 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b.info is being set with open permissions: ugo+rw Feb 27 12:31:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-92fea564-de1f-4cd6-925d-aa46e0b5b495 tempest-SnapshotMetadataTestJSON-930836664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:13 devstack sudo[86810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b.info Feb 27 12:31:13 devstack sudo[86810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:13 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:31:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Flow 'volume_create_manager' (bb1235f8-a9b4-4ae6-aeb9-a551ecc8b385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28553ad1-68a3-4217-a3bd-31a6c8e9658c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28553ad1-68a3-4217-a3bd-31a6c8e9658c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1100759486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7cb7922-01a4-424c-9fab-e51d53660214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9efd9d3f52184a73bc3e993f4def7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:13Z,use_quota=True,user_id='5100277d035744ff9ac8e7e06d4abd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865ae109-c85f-4fe1-9b35-0131a742b2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865ae109-c85f-4fe1-9b35-0131a742b2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea4fea60-797e-4a94-8755-d289da33bd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea4fea60-797e-4a94-8755-d289da33bd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7cb7922-01a4-424c-9fab-e51d53660214', 'volume_name': 'volume-c7cb7922-01a4-424c-9fab-e51d53660214', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19269477-6ad6-47d4-aa8b-5f69be7e05af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19269477-6ad6-47d4-aa8b-5f69be7e05af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e79ee21c-a02f-4061-ab6d-cb8ccbb438b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:13 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Volume c7cb7922-01a4-424c-9fab-e51d53660214: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7cb7922-01a4-424c-9fab-e51d53660214', 'volume_size': 1} Feb 27 12:31:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:13 devstack sudo[86810]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-92fea564-de1f-4cd6-925d-aa46e0b5b495 tempest-SnapshotMetadataTestJSON-930836664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b.info" returned: 0 in 0.458s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-92fea564-de1f-4cd6-925d-aa46e0b5b495 tempest-SnapshotMetadataTestJSON-930836664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.119s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-43501a3d-0fb7-4d87-ad7a-74ee8b25e543 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.419s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:13 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-92fea564-de1f-4cd6-925d-aa46e0b5b495 tempest-SnapshotMetadataTestJSON-930836664 None] Create snapshot completed successfully Feb 27 12:31:13 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a88f0c-4332-4c87-89b4-d9733a620797]: (4, 'raw') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-43501a3d-0fb7-4d87-ad7a-74ee8b25e543 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:13 devstack sudo[86813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792 Feb 27 12:31:13 devstack sudo[86813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:14 devstack sudo[86813]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-43501a3d-0fb7-4d87-ad7a-74ee8b25e543 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792" returned: 0 in 0.504s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-43501a3d-0fb7-4d87-ad7a-74ee8b25e543 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:14 devstack sudo[86817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792 Feb 27 12:31:14 devstack sudo[86817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:14 devstack sudo[86817]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-43501a3d-0fb7-4d87-ad7a-74ee8b25e543 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792" returned: 1 in 0.486s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-43501a3d-0fb7-4d87-ad7a-74ee8b25e543 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792' failed. Not Retrying. {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-43501a3d-0fb7-4d87-ad7a-74ee8b25e543 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.020s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.307s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1100759486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7cb7922-01a4-424c-9fab-e51d53660214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9efd9d3f52184a73bc3e993f4def7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:13Z,use_quota=True,user_id='5100277d035744ff9ac8e7e06d4abd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Creating volume c7cb7922-01a4-424c-9fab-e51d53660214 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:31:14 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:14 devstack sudo[86822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214 1073741824 Feb 27 12:31:14 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-43501a3d-0fb7-4d87-ad7a-74ee8b25e543 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84', 'name': 'volume-12113f0f-f609-4278-866a-dd60fc600792', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc1becd1-1c9d-435f-b6ce-845e7e4f41da', 'enforce_multipath': True} {{(pid=83077) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 27 12:31:14 devstack cinder-volume[83077]: INFO cinder.volume.manager [req-fa39dfa7-af7f-419a-9d05-a88a94abecbd req-43501a3d-0fb7-4d87-ad7a-74ee8b25e543 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] attachment_update completed successfully. Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Flow 'volume_create_manager' (c6f835b4-ac5d-4ac2-b7b4-92448ffdd6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7dd5849-c424-469e-9be2-3659bfa65ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7dd5849-c424-469e-9be2-3659bfa65ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1273430498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83df55e-3c40-48fc-aa36-e3bee047351e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f89aa4bc3b44209e17153326a83b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:15Z,use_quota=True,user_id='55adf028acc4428e92e07bb9e21b4322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c6d1e0-b4d9-4ff9-81ec-eebb6c40530c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c6d1e0-b4d9-4ff9-81ec-eebb6c40530c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9723ea21-1106-4f5f-9865-cebead040a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9723ea21-1106-4f5f-9865-cebead040a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f83df55e-3c40-48fc-aa36-e3bee047351e', 'volume_name': 'volume-f83df55e-3c40-48fc-aa36-e3bee047351e', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a20dd519-8e2a-4403-b855-cfc6dde13229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a20dd519-8e2a-4403-b855-cfc6dde13229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7720896-1bbe-438f-aefc-9467ddb84168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:14 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Volume f83df55e-3c40-48fc-aa36-e3bee047351e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f83df55e-3c40-48fc-aa36-e3bee047351e', 'volume_size': 1} Feb 27 12:31:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:15 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214 1073741824" returned: 0 in 0.539s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:15 devstack sudo[86827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214 Feb 27 12:31:15 devstack sudo[86827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1b2951f1-cb17-4224-80d1-f1f7ec5ba675 tempest-SnapshotMetadataTestJSON-930836664 None] Acquiring lock "cinder-d2faa1a7-d5a1-494c-8451-474166c44aa2-delete_snapshot" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1b2951f1-cb17-4224-80d1-f1f7ec5ba675 tempest-SnapshotMetadataTestJSON-930836664 None] Lock "cinder-d2faa1a7-d5a1-494c-8451-474166c44aa2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1b2951f1-cb17-4224-80d1-f1f7ec5ba675 tempest-SnapshotMetadataTestJSON-930836664 None] Acquiring lock "cinder-quobyte-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1b2951f1-cb17-4224-80d1-f1f7ec5ba675 tempest-SnapshotMetadataTestJSON-930836664 None] Lock "cinder-quobyte-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1b2951f1-cb17-4224-80d1-f1f7ec5ba675 tempest-SnapshotMetadataTestJSON-930836664 None] Acquiring lock "cinder-quobyte-d2faa1a7-d5a1-494c-8451-474166c44aa2" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1b2951f1-cb17-4224-80d1-f1f7ec5ba675 tempest-SnapshotMetadataTestJSON-930836664 None] Lock "cinder-quobyte-d2faa1a7-d5a1-494c-8451-474166c44aa2" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-1b2951f1-cb17-4224-80d1-f1f7ec5ba675 tempest-SnapshotMetadataTestJSON-930836664 None] Deleting offline snapshot d2faa1a7-d5a1-494c-8451-474166c44aa2 of volume 6bc6b8b1-7751-4070-89c5-3cbf9d6c694b {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-1b2951f1-cb17-4224-80d1-f1f7ec5ba675 tempest-SnapshotMetadataTestJSON-930836664 None] snapshot_file for this snap is: volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b.d2faa1a7-d5a1-494c-8451-474166c44aa2 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e5bd88-0c12-42a9-b989-39f3f9f06efe]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1b2951f1-cb17-4224-80d1-f1f7ec5ba675 tempest-SnapshotMetadataTestJSON-930836664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b.d2faa1a7-d5a1-494c-8451-474166c44aa2 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:15 devstack sudo[86829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b.d2faa1a7-d5a1-494c-8451-474166c44aa2 Feb 27 12:31:15 devstack sudo[86829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:15 devstack sudo[86827]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214" returned: 0 in 0.423s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.726s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1273430498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83df55e-3c40-48fc-aa36-e3bee047351e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f89aa4bc3b44209e17153326a83b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:15Z,use_quota=True,user_id='55adf028acc4428e92e07bb9e21b4322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Creating volume f83df55e-3c40-48fc-aa36-e3bee047351e {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:31:15 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f83df55e-3c40-48fc-aa36-e3bee047351e 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e79ee21c-a02f-4061-ab6d-cb8ccbb438b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7cb7922-01a4-424c-9fab-e51d53660214', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:15 devstack sudo[86832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f83df55e-3c40-48fc-aa36-e3bee047351e 1073741824 Feb 27 12:31:15 devstack sudo[86832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547bd2a5-54cb-4cbb-94a1-29048be7d71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:15 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Volume volume-c7cb7922-01a4-424c-9fab-e51d53660214 (c7cb7922-01a4-424c-9fab-e51d53660214): created successfully Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547bd2a5-54cb-4cbb-94a1-29048be7d71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Flow 'volume_create_manager' (bb1235f8-a9b4-4ae6-aeb9-a551ecc8b385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:15 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-679b58a5-e525-4225-ad14-4cb4af7b6014 tempest-VolumesSnapshotTestJSON-246952173 None] Created volume successfully. Feb 27 12:31:15 devstack sudo[86829]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1b2951f1-cb17-4224-80d1-f1f7ec5ba675 tempest-SnapshotMetadataTestJSON-930836664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b.d2faa1a7-d5a1-494c-8451-474166c44aa2" returned: 0 in 0.517s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-1b2951f1-cb17-4224-80d1-f1f7ec5ba675 tempest-SnapshotMetadataTestJSON-930836664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[334533a1-f545-4f93-8163-76c53509d654]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1b2951f1-cb17-4224-80d1-f1f7ec5ba675 tempest-SnapshotMetadataTestJSON-930836664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:15 devstack sudo[86837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b Feb 27 12:31:15 devstack sudo[86837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:16 devstack sudo[86832]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f83df55e-3c40-48fc-aa36-e3bee047351e 1073741824" returned: 0 in 0.483s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f83df55e-3c40-48fc-aa36-e3bee047351e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:16 devstack sudo[86842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f83df55e-3c40-48fc-aa36-e3bee047351e Feb 27 12:31:16 devstack sudo[86842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-657841f1-670e-4a1d-a723-da4a0dcb8fd2 tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:16 devstack sudo[86837]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1b2951f1-cb17-4224-80d1-f1f7ec5ba675 tempest-SnapshotMetadataTestJSON-930836664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b" returned: 0 in 0.690s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1b2951f1-cb17-4224-80d1-f1f7ec5ba675 tempest-SnapshotMetadataTestJSON-930836664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b.d2faa1a7-d5a1-494c-8451-474166c44aa2 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:16 devstack sudo[86848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b.d2faa1a7-d5a1-494c-8451-474166c44aa2 Feb 27 12:31:16 devstack sudo[86848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:16 devstack sudo[86842]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f83df55e-3c40-48fc-aa36-e3bee047351e" returned: 0 in 0.549s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:31:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-657841f1-670e-4a1d-a723-da4a0dcb8fd2 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.082s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7720896-1bbe-438f-aefc-9467ddb84168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f83df55e-3c40-48fc-aa36-e3bee047351e', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9a1e1e-491a-43cf-ac22-9a60223f2faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-657841f1-670e-4a1d-a723-da4a0dcb8fd2 tempest-VolumesSnapshotTestJSON-246952173 None] Creating offline snapshot 01e65f6d-f206-49c1-bd21-8f51dc4d2118 of volume c7cb7922-01a4-424c-9fab-e51d53660214 {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:31:16 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Volume volume-f83df55e-3c40-48fc-aa36-e3bee047351e (f83df55e-3c40-48fc-aa36-e3bee047351e): created successfully Feb 27 12:31:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9a1e1e-491a-43cf-ac22-9a60223f2faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Flow 'volume_create_manager' (c6f835b4-ac5d-4ac2-b7b4-92448ffdd6c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:16 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[12257d37-e930-4e5e-851c-cc1d72f0422a]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-657841f1-670e-4a1d-a723-da4a0dcb8fd2 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:16 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-54727789-ee07-4e64-bf99-9cfa4edfb597 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Created volume successfully. Feb 27 12:31:16 devstack sudo[86850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214 Feb 27 12:31:16 devstack sudo[86850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:16 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-67fa5a89-22a5-4aa6-8f81-2a06b8d71ca9 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Acquiring lock "cinder-f83df55e-3c40-48fc-aa36-e3bee047351e-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:16 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-67fa5a89-22a5-4aa6-8f81-2a06b8d71ca9 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Lock "cinder-f83df55e-3c40-48fc-aa36-e3bee047351e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:16 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-67fa5a89-22a5-4aa6-8f81-2a06b8d71ca9 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Acquiring lock "cinder-quobyte-f83df55e-3c40-48fc-aa36-e3bee047351e" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:16 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-67fa5a89-22a5-4aa6-8f81-2a06b8d71ca9 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Lock "cinder-quobyte-f83df55e-3c40-48fc-aa36-e3bee047351e" acquired by "delete_volume" :: waited 0.018s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:17 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c986fd-c52f-4f73-8ae8-4a8ee23493ca]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67fa5a89-22a5-4aa6-8f81-2a06b8d71ca9 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f83df55e-3c40-48fc-aa36-e3bee047351e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:17 devstack sudo[86848]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1b2951f1-cb17-4224-80d1-f1f7ec5ba675 tempest-SnapshotMetadataTestJSON-930836664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b.d2faa1a7-d5a1-494c-8451-474166c44aa2" returned: 0 in 0.499s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1b2951f1-cb17-4224-80d1-f1f7ec5ba675 tempest-SnapshotMetadataTestJSON-930836664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b.d2faa1a7-d5a1-494c-8451-474166c44aa2 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:17 devstack sudo[86856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b.d2faa1a7-d5a1-494c-8451-474166c44aa2 Feb 27 12:31:17 devstack sudo[86856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:17 devstack sudo[86855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f83df55e-3c40-48fc-aa36-e3bee047351e Feb 27 12:31:17 devstack sudo[86855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:17 devstack sudo[86850]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-657841f1-670e-4a1d-a723-da4a0dcb8fd2 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214" returned: 0 in 0.564s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-657841f1-670e-4a1d-a723-da4a0dcb8fd2 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.01e65f6d-f206-49c1-bd21-8f51dc4d2118 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:17 devstack sudo[86862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.01e65f6d-f206-49c1-bd21-8f51dc4d2118 1G Feb 27 12:31:17 devstack sudo[86862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:17 devstack sudo[86856]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1b2951f1-cb17-4224-80d1-f1f7ec5ba675 tempest-SnapshotMetadataTestJSON-930836664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b.d2faa1a7-d5a1-494c-8451-474166c44aa2" returned: 0 in 0.431s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1b2951f1-cb17-4224-80d1-f1f7ec5ba675 tempest-SnapshotMetadataTestJSON-930836664 None] Lock "cinder-quobyte-d2faa1a7-d5a1-494c-8451-474166c44aa2" released by "_delete_snapshot" :: held 2.210s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:17 devstack sudo[86855]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1b2951f1-cb17-4224-80d1-f1f7ec5ba675 tempest-SnapshotMetadataTestJSON-930836664 None] Lock "cinder-quobyte-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b" released by "delete_snapshot" :: held 2.237s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:17 devstack cinder-volume[83077]: DEBUG dbcounter [-] [83077] Writing DB stats cinder:SELECT=160,cinder:UPDATE=162,cinder:INSERT=42,cinder:DELETE=16 {{(pid=83077) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:31:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67fa5a89-22a5-4aa6-8f81-2a06b8d71ca9 tempest-VolumeQuotasAdminTestJSON-1158215530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f83df55e-3c40-48fc-aa36-e3bee047351e" returned: 0 in 0.516s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67fa5a89-22a5-4aa6-8f81-2a06b8d71ca9 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f83df55e-3c40-48fc-aa36-e3bee047351e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:17 devstack sudo[86868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f83df55e-3c40-48fc-aa36-e3bee047351e Feb 27 12:31:17 devstack sudo[86868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:17 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-1b2951f1-cb17-4224-80d1-f1f7ec5ba675 tempest-SnapshotMetadataTestJSON-930836664 None] Created reservations ['f3ebe033-d923-4ba7-b82a-18cfe40b9431', 'fcd38b4b-9be6-4347-9237-c2f1924f1778', '83960057-0e8c-42ce-be3f-eb4e35641bab', 'bfb5ab2d-096b-4948-b6b5-e234fc3dd469'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:17 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-1b2951f1-cb17-4224-80d1-f1f7ec5ba675 tempest-SnapshotMetadataTestJSON-930836664 None] Delete snapshot completed successfully. Feb 27 12:31:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1b2951f1-cb17-4224-80d1-f1f7ec5ba675 tempest-SnapshotMetadataTestJSON-930836664 None] Lock "cinder-d2faa1a7-d5a1-494c-8451-474166c44aa2-delete_snapshot" released by "delete_snapshot" :: held 2.378s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:17 devstack sudo[86862]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-657841f1-670e-4a1d-a723-da4a0dcb8fd2 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.01e65f6d-f206-49c1-bd21-8f51dc4d2118 1G" returned: 0 in 0.546s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-657841f1-670e-4a1d-a723-da4a0dcb8fd2 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7cb7922-01a4-424c-9fab-e51d53660214 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.01e65f6d-f206-49c1-bd21-8f51dc4d2118 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:17 devstack sudo[86876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7cb7922-01a4-424c-9fab-e51d53660214 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.01e65f6d-f206-49c1-bd21-8f51dc4d2118 Feb 27 12:31:17 devstack sudo[86876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:17 devstack sudo[86868]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67fa5a89-22a5-4aa6-8f81-2a06b8d71ca9 tempest-VolumeQuotasAdminTestJSON-1158215530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f83df55e-3c40-48fc-aa36-e3bee047351e" returned: 0 in 0.429s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-67fa5a89-22a5-4aa6-8f81-2a06b8d71ca9 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Lock "cinder-quobyte-f83df55e-3c40-48fc-aa36-e3bee047351e" released by "delete_volume" :: held 0.980s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:17 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-67fa5a89-22a5-4aa6-8f81-2a06b8d71ca9 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Created reservations ['ba10e674-ea85-40f1-b036-b4325fbdbd33', '47799d4d-0329-4c2c-94c8-7d29125c66e1', 'f32214b7-0f4e-472f-b1cd-990ac2711ea0', '2129069f-1887-486c-b134-dcc0a50dfd09'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-67fa5a89-22a5-4aa6-8f81-2a06b8d71ca9 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-67fa5a89-22a5-4aa6-8f81-2a06b8d71ca9 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:18 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-67fa5a89-22a5-4aa6-8f81-2a06b8d71ca9 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:18 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-67fa5a89-22a5-4aa6-8f81-2a06b8d71ca9 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-67fa5a89-22a5-4aa6-8f81-2a06b8d71ca9 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67fa5a89-22a5-4aa6-8f81-2a06b8d71ca9 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:18 devstack sudo[86879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:31:18 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:18 devstack sudo[86876]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-657841f1-670e-4a1d-a723-da4a0dcb8fd2 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7cb7922-01a4-424c-9fab-e51d53660214 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.01e65f6d-f206-49c1-bd21-8f51dc4d2118" returned: 0 in 0.429s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:18 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-657841f1-670e-4a1d-a723-da4a0dcb8fd2 tempest-VolumesSnapshotTestJSON-246952173 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.01e65f6d-f206-49c1-bd21-8f51dc4d2118 is being set with open permissions: ugo+rw Feb 27 12:31:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-657841f1-670e-4a1d-a723-da4a0dcb8fd2 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.01e65f6d-f206-49c1-bd21-8f51dc4d2118 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:18 devstack sudo[86884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.01e65f6d-f206-49c1-bd21-8f51dc4d2118 Feb 27 12:31:18 devstack sudo[86884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:18 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d06bfa86-0d7d-4706-8f6a-85d8ee10772b tempest-SnapshotMetadataTestJSON-930836664 None] Acquiring lock "cinder-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:18 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d06bfa86-0d7d-4706-8f6a-85d8ee10772b tempest-SnapshotMetadataTestJSON-930836664 None] Lock "cinder-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:18 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d06bfa86-0d7d-4706-8f6a-85d8ee10772b tempest-SnapshotMetadataTestJSON-930836664 None] Acquiring lock "cinder-quobyte-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:18 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67fa5a89-22a5-4aa6-8f81-2a06b8d71ca9 tempest-VolumeQuotasAdminTestJSON-1158215530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.440s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:18 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-67fa5a89-22a5-4aa6-8f81-2a06b8d71ca9 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:31:18 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d06bfa86-0d7d-4706-8f6a-85d8ee10772b tempest-SnapshotMetadataTestJSON-930836664 None] Lock "cinder-quobyte-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b" acquired by "delete_volume" :: waited 0.012s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:18 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-67fa5a89-22a5-4aa6-8f81-2a06b8d71ca9 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Deleted volume successfully. Feb 27 12:31:18 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14121d6-f181-4ebb-a16f-b4a3bb13bd82]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d06bfa86-0d7d-4706-8f6a-85d8ee10772b tempest-SnapshotMetadataTestJSON-930836664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:18 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-67fa5a89-22a5-4aa6-8f81-2a06b8d71ca9 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Lock "cinder-f83df55e-3c40-48fc-aa36-e3bee047351e-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:18 devstack sudo[86889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b Feb 27 12:31:18 devstack sudo[86889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:18 devstack sudo[86884]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-657841f1-670e-4a1d-a723-da4a0dcb8fd2 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.01e65f6d-f206-49c1-bd21-8f51dc4d2118" returned: 0 in 0.452s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-657841f1-670e-4a1d-a723-da4a0dcb8fd2 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:18 devstack sudo[86894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.info Feb 27 12:31:18 devstack sudo[86894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:19 devstack sudo[86889]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d06bfa86-0d7d-4706-8f6a-85d8ee10772b tempest-SnapshotMetadataTestJSON-930836664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b" returned: 0 in 0.506s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d06bfa86-0d7d-4706-8f6a-85d8ee10772b tempest-SnapshotMetadataTestJSON-930836664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:19 devstack sudo[86909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b Feb 27 12:31:19 devstack sudo[86909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:19 devstack sudo[86894]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-657841f1-670e-4a1d-a723-da4a0dcb8fd2 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.info" returned: 0 in 0.479s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:19 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-657841f1-670e-4a1d-a723-da4a0dcb8fd2 tempest-VolumesSnapshotTestJSON-246952173 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.info is being set with open permissions: ugo+rw Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-657841f1-670e-4a1d-a723-da4a0dcb8fd2 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:19 devstack sudo[86911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.info Feb 27 12:31:19 devstack sudo[86911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:31:19 devstack sudo[86909]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Flow 'volume_create_manager' (9f80f5bf-bc7b-4b62-811b-2137e0924316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3efdd2d-6037-4be9-bd87-4a7acdf6f4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d06bfa86-0d7d-4706-8f6a-85d8ee10772b tempest-SnapshotMetadataTestJSON-930836664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b" returned: 0 in 0.615s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3efdd2d-6037-4be9-bd87-4a7acdf6f4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2079968897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f89aa4bc3b44209e17153326a83b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:19Z,use_quota=True,user_id='55adf028acc4428e92e07bb9e21b4322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2452197-b2b6-46b5-965b-599864ad3b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2452197-b2b6-46b5-965b-599864ad3b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19c90e3-f873-48e8-8159-413ce5424aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19c90e3-f873-48e8-8159-413ce5424aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47', 'volume_name': 'volume-d94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c78222-6bae-4ebf-9e80-4aa291a8f82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c78222-6bae-4ebf-9e80-4aa291a8f82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac68d2d-d4d7-49af-80dc-37f51643102e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:19 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Volume d94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47', 'volume_size': 1} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d06bfa86-0d7d-4706-8f6a-85d8ee10772b tempest-SnapshotMetadataTestJSON-930836664 None] Lock "cinder-quobyte-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b" released by "delete_volume" :: held 1.216s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-d06bfa86-0d7d-4706-8f6a-85d8ee10772b tempest-SnapshotMetadataTestJSON-930836664 None] Created reservations ['6c3140f3-9ebf-431a-9e08-8b27511a390a', '37ba581b-7d8a-40d4-aa6f-eb4ebbfafd3a', '250601ce-5bf4-4f22-821f-978140b4dc76', '3a35d6c4-c9c0-48fe-b600-048c088d2b2e'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d06bfa86-0d7d-4706-8f6a-85d8ee10772b tempest-SnapshotMetadataTestJSON-930836664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d06bfa86-0d7d-4706-8f6a-85d8ee10772b tempest-SnapshotMetadataTestJSON-930836664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d06bfa86-0d7d-4706-8f6a-85d8ee10772b tempest-SnapshotMetadataTestJSON-930836664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d06bfa86-0d7d-4706-8f6a-85d8ee10772b tempest-SnapshotMetadataTestJSON-930836664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d06bfa86-0d7d-4706-8f6a-85d8ee10772b tempest-SnapshotMetadataTestJSON-930836664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d06bfa86-0d7d-4706-8f6a-85d8ee10772b tempest-SnapshotMetadataTestJSON-930836664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:19 devstack sudo[86911]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-657841f1-670e-4a1d-a723-da4a0dcb8fd2 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.info" returned: 0 in 0.774s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:19 devstack sudo[86939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:31:19 devstack sudo[86939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-657841f1-670e-4a1d-a723-da4a0dcb8fd2 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.329s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.207s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2079968897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f89aa4bc3b44209e17153326a83b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:19Z,use_quota=True,user_id='55adf028acc4428e92e07bb9e21b4322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Creating volume d94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:31:19 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:31:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:19 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-657841f1-670e-4a1d-a723-da4a0dcb8fd2 tempest-VolumesSnapshotTestJSON-246952173 None] Create snapshot completed successfully Feb 27 12:31:19 devstack sudo[86942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47 1073741824 Feb 27 12:31:19 devstack sudo[86942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:20 devstack sudo[86939]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d06bfa86-0d7d-4706-8f6a-85d8ee10772b tempest-SnapshotMetadataTestJSON-930836664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.582s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:20 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-d06bfa86-0d7d-4706-8f6a-85d8ee10772b tempest-SnapshotMetadataTestJSON-930836664 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:31:20 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-d06bfa86-0d7d-4706-8f6a-85d8ee10772b tempest-SnapshotMetadataTestJSON-930836664 None] Deleted volume successfully. Feb 27 12:31:20 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d06bfa86-0d7d-4706-8f6a-85d8ee10772b tempest-SnapshotMetadataTestJSON-930836664 None] Lock "cinder-6bc6b8b1-7751-4070-89c5-3cbf9d6c694b-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:20 devstack sudo[86942]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47 1073741824" returned: 0 in 0.760s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:20 devstack sudo[86948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47 Feb 27 12:31:20 devstack sudo[86948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Flow 'volume_create_manager' (f670274b-fd72-4a9c-875a-fff7d6795c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c24a43-3a9d-43c0-a290-de311da61583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c24a43-3a9d-43c0-a290-de311da61583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-569878771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6a4637c-8c63-4cad-bd80-c7d453b904ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9efd9d3f52184a73bc3e993f4def7b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=01e65f6d-f206-49c1-bd21-8f51dc4d2118,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:21Z,use_quota=True,user_id='5100277d035744ff9ac8e7e06d4abd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fbd584c-60ee-4cbc-ab10-ef915c70d44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fbd584c-60ee-4cbc-ab10-ef915c70d44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eecc96d0-f0df-4c05-bf22-932dcce13532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eecc96d0-f0df-4c05-bf22-932dcce13532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c6a4637c-8c63-4cad-bd80-c7d453b904ea', 'volume_name': 'volume-c6a4637c-8c63-4cad-bd80-c7d453b904ea', 'volume_size': 1, 'snapshot_id': '01e65f6d-f206-49c1-bd21-8f51dc4d2118'}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77fcb4f4-a305-4a2d-88bc-57891abc06aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77fcb4f4-a305-4a2d-88bc-57891abc06aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92cac706-3ac1-4534-b341-4071ef26d221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:21 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Volume c6a4637c-8c63-4cad-bd80-c7d453b904ea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c6a4637c-8c63-4cad-bd80-c7d453b904ea', 'volume_size': 1, 'snapshot_id': '01e65f6d-f206-49c1-bd21-8f51dc4d2118'} Feb 27 12:31:21 devstack sudo[86948]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47" returned: 0 in 0.627s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "cinder-quobyte-01e65f6d-f206-49c1-bd21-8f51dc4d2118-c6a4637c-8c63-4cad-bd80-c7d453b904ea" by "_create_volume_from_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac68d2d-d4d7-49af-80dc-37f51643102e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd56015a-163e-4df2-8a3f-9f038207fa5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-01e65f6d-f206-49c1-bd21-8f51dc4d2118-c6a4637c-8c63-4cad-bd80-c7d453b904ea" acquired by "_create_volume_from_snapshot" :: waited 0.066s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Creating volume c6a4637c-8c63-4cad-bd80-c7d453b904ea from snapshot 01e65f6d-f206-49c1-bd21-8f51dc4d2118 {{(pid=83077) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "cinder-quobyte-c6a4637c-8c63-4cad-bd80-c7d453b904ea" by "_copy_volume_from_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:21 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Volume volume-d94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47 (d94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47): created successfully Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd56015a-163e-4df2-8a3f-9f038207fa5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Flow 'volume_create_manager' (9f80f5bf-bc7b-4b62-811b-2137e0924316) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-c6a4637c-8c63-4cad-bd80-c7d453b904ea" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] snapshot: 01e65f6d-f206-49c1-bd21-8f51dc4d2118, volume: c6a4637c-8c63-4cad-bd80-c7d453b904ea, {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:21 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-163cda72-e8f8-46a8-9093-8aac211fb685 tempest-VolumeQuotasAdminTestJSON-1158215530 None] Created volume successfully. Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[43439abb-b57c-4cc5-b77d-41891df105fd]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.01e65f6d-f206-49c1-bd21-8f51dc4d2118 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:21 devstack sudo[86952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.01e65f6d-f206-49c1-bd21-8f51dc4d2118 Feb 27 12:31:21 devstack sudo[86952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:22 devstack sudo[86952]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.01e65f6d-f206-49c1-bd21-8f51dc4d2118" returned: 0 in 1.007s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7cb7922-01a4-424c-9fab-e51d53660214(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:31:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214 {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 12:31:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Creating direct copy from snapshot {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 12:31:22 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[784d520e-6ab4-4976-bf73-a92e70e38aa3]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:22 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-cdb00f28-0c46-4996-a527-c401ef4330be tempest-VolumeQuotasAdminTestJSON-1102751523 None] Transfer volume completed successfully. Feb 27 12:31:22 devstack sudo[86957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214 Feb 27 12:31:22 devstack sudo[86957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:23 devstack sudo[86957]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214" returned: 0 in 0.716s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:23 devstack cinder-volume[83077]: DEBUG cinder.utils [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Path /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6a4637c-8c63-4cad-bd80-c7d453b904ea not found in is_blk_device check {{(pid=83077) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 12:31:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6a4637c-8c63-4cad-bd80-c7d453b904ea {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:23 devstack sudo[86962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6a4637c-8c63-4cad-bd80-c7d453b904ea Feb 27 12:31:23 devstack sudo[86962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:23 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:31:23 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Flow 'volume_create_manager' (5aea1bd9-853b-40d6-8bc0-fa7bd293dada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:23 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f80bd5-a0a5-4d05-869b-e8227fa81c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:23 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f80bd5-a0a5-4d05-869b-e8227fa81c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-258886479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94736cb6-94d0-4cab-bfa3-e6da368ec7f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc300440c7c4b3db3dddb2c06990970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:23Z,use_quota=True,user_id='6b19d90c41bc429b988af5d679374036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:23 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38da9e5e-f1b4-43c2-8da4-6182641ebccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:23 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38da9e5e-f1b4-43c2-8da4-6182641ebccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:23 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05affdc1-d1f6-410d-bf06-bd9e1701a33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:23 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05affdc1-d1f6-410d-bf06-bd9e1701a33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94736cb6-94d0-4cab-bfa3-e6da368ec7f9', 'volume_name': 'volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:23 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb6d9f15-bd14-43f5-a734-ff9eebe43e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:23 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb6d9f15-bd14-43f5-a734-ff9eebe43e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:23 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe15494-8d9a-4b66-8a90-47710069fa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:23 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Volume 94736cb6-94d0-4cab-bfa3-e6da368ec7f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9', 'volume_size': 1} Feb 27 12:31:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:23 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b3ad9438-b902-40d8-912d-c248c303afcd tempest-VolumeQuotasAdminTestJSON-1678530333 None] Acquiring lock "cinder-d94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:23 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b3ad9438-b902-40d8-912d-c248c303afcd tempest-VolumeQuotasAdminTestJSON-1678530333 None] Lock "cinder-d94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:23 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b3ad9438-b902-40d8-912d-c248c303afcd tempest-VolumeQuotasAdminTestJSON-1678530333 None] Acquiring lock "cinder-quobyte-d94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:23 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b3ad9438-b902-40d8-912d-c248c303afcd tempest-VolumeQuotasAdminTestJSON-1678530333 None] Lock "cinder-quobyte-d94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:23 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6717fe9-d07d-4687-bb72-66fb7e6aa129]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b3ad9438-b902-40d8-912d-c248c303afcd tempest-VolumeQuotasAdminTestJSON-1678530333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:23 devstack sudo[86964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47 Feb 27 12:31:23 devstack sudo[86964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:25 devstack sudo[86964]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b3ad9438-b902-40d8-912d-c248c303afcd tempest-VolumeQuotasAdminTestJSON-1678530333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47" returned: 0 in 1.520s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b3ad9438-b902-40d8-912d-c248c303afcd tempest-VolumeQuotasAdminTestJSON-1678530333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:25 devstack sudo[86979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47 Feb 27 12:31:25 devstack sudo[86979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:25 devstack sudo[86962]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6a4637c-8c63-4cad-bd80-c7d453b904ea" returned: 0 in 2.587s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:25 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[40711d2b-755a-4ce7-869f-83db6a0e0434]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:25 devstack sudo[86981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214 Feb 27 12:31:25 devstack sudo[86981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:26 devstack sudo[86979]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b3ad9438-b902-40d8-912d-c248c303afcd tempest-VolumeQuotasAdminTestJSON-1678530333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47" returned: 0 in 0.991s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b3ad9438-b902-40d8-912d-c248c303afcd tempest-VolumeQuotasAdminTestJSON-1678530333 None] Lock "cinder-quobyte-d94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47" released by "delete_volume" :: held 2.533s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-b3ad9438-b902-40d8-912d-c248c303afcd tempest-VolumeQuotasAdminTestJSON-1678530333 None] Created reservations ['b416294c-8a82-45ce-a745-81be4f184380', '4df3d01c-42b9-440d-82fd-f0c1dee0a7da', 'e802811d-c338-4844-b731-c19ecb9691a4', '6490ad56-bdd9-457d-84dd-e18c19defa7d'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b3ad9438-b902-40d8-912d-c248c303afcd tempest-VolumeQuotasAdminTestJSON-1678530333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b3ad9438-b902-40d8-912d-c248c303afcd tempest-VolumeQuotasAdminTestJSON-1678530333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b3ad9438-b902-40d8-912d-c248c303afcd tempest-VolumeQuotasAdminTestJSON-1678530333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b3ad9438-b902-40d8-912d-c248c303afcd tempest-VolumeQuotasAdminTestJSON-1678530333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b3ad9438-b902-40d8-912d-c248c303afcd tempest-VolumeQuotasAdminTestJSON-1678530333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b3ad9438-b902-40d8-912d-c248c303afcd tempest-VolumeQuotasAdminTestJSON-1678530333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:26 devstack sudo[86984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:31:26 devstack sudo[86984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:26 devstack sudo[86981]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214" returned: 0 in 0.646s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Image conversion details: src /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214, size 1024.00 MB, duration 2.59 sec, destination /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6a4637c-8c63-4cad-bd80-c7d453b904ea {{(pid=83077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:31:26 devstack cinder-volume[83077]: INFO cinder.image.image_utils [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Converted 1024.00 MB image at 395.63 MB/s Feb 27 12:31:26 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6a4637c-8c63-4cad-bd80-c7d453b904ea is being set with open permissions: ugo+rw Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6a4637c-8c63-4cad-bd80-c7d453b904ea {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:26 devstack sudo[87027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6a4637c-8c63-4cad-bd80-c7d453b904ea Feb 27 12:31:26 devstack sudo[87027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:26 devstack sudo[86984]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b3ad9438-b902-40d8-912d-c248c303afcd tempest-VolumeQuotasAdminTestJSON-1678530333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.473s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-b3ad9438-b902-40d8-912d-c248c303afcd tempest-VolumeQuotasAdminTestJSON-1678530333 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:31:26 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-b3ad9438-b902-40d8-912d-c248c303afcd tempest-VolumeQuotasAdminTestJSON-1678530333 None] Deleted volume successfully. Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b3ad9438-b902-40d8-912d-c248c303afcd tempest-VolumeQuotasAdminTestJSON-1678530333 None] Lock "cinder-d94b4ec2-ddfc-4b3f-ab3b-0fad4c9b2c47-delete_volume" released by "delete_volume" :: held 3.141s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:26 devstack sudo[87027]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6a4637c-8c63-4cad-bd80-c7d453b904ea" returned: 0 in 0.431s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-c6a4637c-8c63-4cad-bd80-c7d453b904ea" released by "_copy_volume_from_snapshot" :: held 5.456s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-01e65f6d-f206-49c1-bd21-8f51dc4d2118-c6a4637c-8c63-4cad-bd80-c7d453b904ea" released by "_create_volume_from_snapshot" :: held 5.500s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.567s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.508s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-258886479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94736cb6-94d0-4cab-bfa3-e6da368ec7f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc300440c7c4b3db3dddb2c06990970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:23Z,use_quota=True,user_id='6b19d90c41bc429b988af5d679374036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Creating volume 94736cb6-94d0-4cab-bfa3-e6da368ec7f9 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:31:26 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:26 devstack sudo[87033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9 1073741824 Feb 27 12:31:26 devstack sudo[87033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92cac706-3ac1-4534-b341-4071ef26d221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6a4637c-8c63-4cad-bd80-c7d453b904ea', 'volume_size': 1, 'snapshot_id': '01e65f6d-f206-49c1-bd21-8f51dc4d2118'}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f522b0fb-b695-45c4-afa9-b97dd1bc374b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:26 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Volume volume-c6a4637c-8c63-4cad-bd80-c7d453b904ea (c6a4637c-8c63-4cad-bd80-c7d453b904ea): created successfully Feb 27 12:31:27 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f522b0fb-b695-45c4-afa9-b97dd1bc374b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:27 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Flow 'volume_create_manager' (f670274b-fd72-4a9c-875a-fff7d6795c36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:27 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-50468e2c-89e5-4765-9b97-5dac7d87b0df tempest-VolumesSnapshotTestJSON-246952173 None] Created volume successfully. Feb 27 12:31:27 devstack sudo[87033]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9 1073741824" returned: 0 in 0.572s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:27 devstack sudo[87038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9 Feb 27 12:31:27 devstack sudo[87038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:28 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d131f335-7b60-4b59-8cb3-1da5f956b6fb tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "cinder-c6a4637c-8c63-4cad-bd80-c7d453b904ea-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:28 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d131f335-7b60-4b59-8cb3-1da5f956b6fb tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-c6a4637c-8c63-4cad-bd80-c7d453b904ea-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:28 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d131f335-7b60-4b59-8cb3-1da5f956b6fb tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "cinder-quobyte-c6a4637c-8c63-4cad-bd80-c7d453b904ea" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:28 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d131f335-7b60-4b59-8cb3-1da5f956b6fb tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-c6a4637c-8c63-4cad-bd80-c7d453b904ea" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:28 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac1a6db-bb26-41fd-9674-f296f4aaa145]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d131f335-7b60-4b59-8cb3-1da5f956b6fb tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6a4637c-8c63-4cad-bd80-c7d453b904ea {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:28 devstack sudo[87038]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9" returned: 0 in 0.654s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:28 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:31:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:28 devstack sudo[87064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6a4637c-8c63-4cad-bd80-c7d453b904ea Feb 27 12:31:28 devstack sudo[87064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:28 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe15494-8d9a-4b66-8a90-47710069fa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:28 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fba413c-7293-4b67-9e01-59ca79714b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:28 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Volume volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9 (94736cb6-94d0-4cab-bfa3-e6da368ec7f9): created successfully Feb 27 12:31:28 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fba413c-7293-4b67-9e01-59ca79714b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:28 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Flow 'volume_create_manager' (5aea1bd9-853b-40d6-8bc0-fa7bd293dada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:28 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-173fb074-be64-4179-80b6-5be2e9d9b165 tempest-VolumesDeleteCascade-1708497653 None] Created volume successfully. Feb 27 12:31:28 devstack sudo[87064]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d131f335-7b60-4b59-8cb3-1da5f956b6fb tempest-VolumesSnapshotTestJSON-246952173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6a4637c-8c63-4cad-bd80-c7d453b904ea" returned: 0 in 0.581s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d131f335-7b60-4b59-8cb3-1da5f956b6fb tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6a4637c-8c63-4cad-bd80-c7d453b904ea {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:28 devstack sudo[87070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6a4637c-8c63-4cad-bd80-c7d453b904ea Feb 27 12:31:28 devstack sudo[87070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-06c08bca-dc32-42fe-99c8-b829d17c37f4 tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-06c08bca-dc32-42fe-99c8-b829d17c37f4 tempest-VolumesDeleteCascade-1708497653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:29 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-06c08bca-dc32-42fe-99c8-b829d17c37f4 tempest-VolumesDeleteCascade-1708497653 None] Creating offline snapshot 6f6d6a2f-2709-4103-bae8-8338d68d3b3e of volume 94736cb6-94d0-4cab-bfa3-e6da368ec7f9 {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:31:29 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[a083f3e7-c9ff-4f28-8850-ae09d0ebb757]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-06c08bca-dc32-42fe-99c8-b829d17c37f4 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:29 devstack sudo[87070]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d131f335-7b60-4b59-8cb3-1da5f956b6fb tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6a4637c-8c63-4cad-bd80-c7d453b904ea" returned: 0 in 0.531s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:29 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d131f335-7b60-4b59-8cb3-1da5f956b6fb tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-c6a4637c-8c63-4cad-bd80-c7d453b904ea" released by "delete_volume" :: held 1.153s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:29 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-d131f335-7b60-4b59-8cb3-1da5f956b6fb tempest-VolumesSnapshotTestJSON-246952173 None] Created reservations ['2ad03072-8527-4210-be45-7e0c01553a9f', '024996bb-371a-4d93-b023-81c2e0347d12', '97d1c27d-0338-4bc8-96b0-1bc6a2d69ddb', 'f3c93b18-2b57-4601-ba8f-dbce04ecd37a'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:29 devstack sudo[87073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9 Feb 27 12:31:29 devstack sudo[87073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d131f335-7b60-4b59-8cb3-1da5f956b6fb tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d131f335-7b60-4b59-8cb3-1da5f956b6fb tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:29 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d131f335-7b60-4b59-8cb3-1da5f956b6fb tempest-VolumesSnapshotTestJSON-246952173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:29 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d131f335-7b60-4b59-8cb3-1da5f956b6fb tempest-VolumesSnapshotTestJSON-246952173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d131f335-7b60-4b59-8cb3-1da5f956b6fb tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d131f335-7b60-4b59-8cb3-1da5f956b6fb tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:29 devstack sudo[87076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:31:29 devstack sudo[87076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:29 devstack sudo[87073]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-06c08bca-dc32-42fe-99c8-b829d17c37f4 tempest-VolumesDeleteCascade-1708497653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9" returned: 0 in 0.590s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-06c08bca-dc32-42fe-99c8-b829d17c37f4 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:29 devstack sudo[87091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e 1G Feb 27 12:31:29 devstack sudo[87091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:29 devstack sudo[87076]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d131f335-7b60-4b59-8cb3-1da5f956b6fb tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.565s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:29 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-d131f335-7b60-4b59-8cb3-1da5f956b6fb tempest-VolumesSnapshotTestJSON-246952173 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:31:29 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-d131f335-7b60-4b59-8cb3-1da5f956b6fb tempest-VolumesSnapshotTestJSON-246952173 None] Deleted volume successfully. Feb 27 12:31:29 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d131f335-7b60-4b59-8cb3-1da5f956b6fb tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-c6a4637c-8c63-4cad-bd80-c7d453b904ea-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:30 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4b84cf4b-3bf2-47d8-9e61-85979f39d802 tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "cinder-01e65f6d-f206-49c1-bd21-8f51dc4d2118-delete_snapshot" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:30 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4b84cf4b-3bf2-47d8-9e61-85979f39d802 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-01e65f6d-f206-49c1-bd21-8f51dc4d2118-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:30 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4b84cf4b-3bf2-47d8-9e61-85979f39d802 tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "cinder-quobyte-c7cb7922-01a4-424c-9fab-e51d53660214" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:30 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4b84cf4b-3bf2-47d8-9e61-85979f39d802 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-c7cb7922-01a4-424c-9fab-e51d53660214" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:30 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4b84cf4b-3bf2-47d8-9e61-85979f39d802 tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "cinder-quobyte-01e65f6d-f206-49c1-bd21-8f51dc4d2118" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:30 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4b84cf4b-3bf2-47d8-9e61-85979f39d802 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-01e65f6d-f206-49c1-bd21-8f51dc4d2118" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:30 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-4b84cf4b-3bf2-47d8-9e61-85979f39d802 tempest-VolumesSnapshotTestJSON-246952173 None] Deleting offline snapshot 01e65f6d-f206-49c1-bd21-8f51dc4d2118 of volume c7cb7922-01a4-424c-9fab-e51d53660214 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:31:30 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-4b84cf4b-3bf2-47d8-9e61-85979f39d802 tempest-VolumesSnapshotTestJSON-246952173 None] snapshot_file for this snap is: volume-c7cb7922-01a4-424c-9fab-e51d53660214.01e65f6d-f206-49c1-bd21-8f51dc4d2118 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:31:30 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[667ced47-b736-4f24-9708-465405d84517]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4b84cf4b-3bf2-47d8-9e61-85979f39d802 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.01e65f6d-f206-49c1-bd21-8f51dc4d2118 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:30 devstack sudo[87091]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-06c08bca-dc32-42fe-99c8-b829d17c37f4 tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e 1G" returned: 0 in 0.617s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-06c08bca-dc32-42fe-99c8-b829d17c37f4 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:30 devstack sudo[87102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e Feb 27 12:31:30 devstack sudo[87102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:30 devstack sudo[87101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.01e65f6d-f206-49c1-bd21-8f51dc4d2118 Feb 27 12:31:30 devstack sudo[87101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:30 devstack sudo[87102]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-06c08bca-dc32-42fe-99c8-b829d17c37f4 tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e" returned: 0 in 0.456s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:30 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-06c08bca-dc32-42fe-99c8-b829d17c37f4 tempest-VolumesDeleteCascade-1708497653 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e is being set with open permissions: ugo+rw Feb 27 12:31:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-06c08bca-dc32-42fe-99c8-b829d17c37f4 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:30 devstack sudo[87111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e Feb 27 12:31:30 devstack sudo[87111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:30 devstack sudo[87101]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4b84cf4b-3bf2-47d8-9e61-85979f39d802 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.01e65f6d-f206-49c1-bd21-8f51dc4d2118" returned: 0 in 0.542s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:30 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-4b84cf4b-3bf2-47d8-9e61-85979f39d802 tempest-VolumesSnapshotTestJSON-246952173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7cb7922-01a4-424c-9fab-e51d53660214(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:31:30 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0f274a-a88e-417f-8301-d2843c8dff65]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4b84cf4b-3bf2-47d8-9e61-85979f39d802 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:30 devstack sudo[87114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214 Feb 27 12:31:30 devstack sudo[87114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:31 devstack sudo[87111]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-06c08bca-dc32-42fe-99c8-b829d17c37f4 tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e" returned: 0 in 0.464s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-06c08bca-dc32-42fe-99c8-b829d17c37f4 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:31 devstack sudo[87117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.info Feb 27 12:31:31 devstack sudo[87117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:31 devstack sudo[87114]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4b84cf4b-3bf2-47d8-9e61-85979f39d802 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214" returned: 0 in 0.556s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4b84cf4b-3bf2-47d8-9e61-85979f39d802 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.01e65f6d-f206-49c1-bd21-8f51dc4d2118 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:31 devstack sudo[87122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.01e65f6d-f206-49c1-bd21-8f51dc4d2118 Feb 27 12:31:31 devstack sudo[87122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:31 devstack sudo[87117]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-06c08bca-dc32-42fe-99c8-b829d17c37f4 tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.info" returned: 0 in 0.445s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:31 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-06c08bca-dc32-42fe-99c8-b829d17c37f4 tempest-VolumesDeleteCascade-1708497653 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.info is being set with open permissions: ugo+rw Feb 27 12:31:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-06c08bca-dc32-42fe-99c8-b829d17c37f4 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:31 devstack sudo[87125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.info Feb 27 12:31:31 devstack sudo[87125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:31 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:31:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Flow 'volume_create_manager' (5c690d91-7a40-4021-87e7-689542fee60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157cf520-7185-4af8-8114-991cb6bbcac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:31 devstack sudo[87122]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157cf520-7185-4af8-8114-991cb6bbcac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-873397663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=173fb169-0dee-4f1b-bb80-dacef86ea2b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f7653db6df401e96f189411ae6808c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:32Z,use_quota=True,user_id='e79a192b82e048fb92e13896ceb828a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03074b43-2edb-4c33-89cf-9b7eab28883f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03074b43-2edb-4c33-89cf-9b7eab28883f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8398edd-5d94-4572-9a4a-9250ce195074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8398edd-5d94-4572-9a4a-9250ce195074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '173fb169-0dee-4f1b-bb80-dacef86ea2b0', 'volume_name': 'volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c70ebb0-e4cd-45ea-8e2e-abaf63db971b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c70ebb0-e4cd-45ea-8e2e-abaf63db971b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e3ca568-c979-4a11-aa85-ee747c72f0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:31 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Volume 173fb169-0dee-4f1b-bb80-dacef86ea2b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0', 'volume_size': 1} Feb 27 12:31:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4b84cf4b-3bf2-47d8-9e61-85979f39d802 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.01e65f6d-f206-49c1-bd21-8f51dc4d2118" returned: 0 in 0.530s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4b84cf4b-3bf2-47d8-9e61-85979f39d802 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.01e65f6d-f206-49c1-bd21-8f51dc4d2118 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:32 devstack sudo[87130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.01e65f6d-f206-49c1-bd21-8f51dc4d2118 Feb 27 12:31:32 devstack sudo[87130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:32 devstack sudo[87125]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-06c08bca-dc32-42fe-99c8-b829d17c37f4 tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.info" returned: 0 in 0.512s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-06c08bca-dc32-42fe-99c8-b829d17c37f4 tempest-VolumesDeleteCascade-1708497653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.152s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.297s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:32 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-873397663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=173fb169-0dee-4f1b-bb80-dacef86ea2b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f7653db6df401e96f189411ae6808c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:32Z,use_quota=True,user_id='e79a192b82e048fb92e13896ceb828a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:31:32 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Creating volume 173fb169-0dee-4f1b-bb80-dacef86ea2b0 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:31:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:32 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:32 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:32 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:31:32 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:31:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:32 devstack sudo[87133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0 1073741824 Feb 27 12:31:32 devstack sudo[87133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:32 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-06c08bca-dc32-42fe-99c8-b829d17c37f4 tempest-VolumesDeleteCascade-1708497653 None] Create snapshot completed successfully Feb 27 12:31:32 devstack sudo[87130]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4b84cf4b-3bf2-47d8-9e61-85979f39d802 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214.01e65f6d-f206-49c1-bd21-8f51dc4d2118" returned: 0 in 0.465s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:32 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4b84cf4b-3bf2-47d8-9e61-85979f39d802 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-01e65f6d-f206-49c1-bd21-8f51dc4d2118" released by "_delete_snapshot" :: held 2.167s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:32 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4b84cf4b-3bf2-47d8-9e61-85979f39d802 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-c7cb7922-01a4-424c-9fab-e51d53660214" released by "delete_snapshot" :: held 2.178s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:32 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-4b84cf4b-3bf2-47d8-9e61-85979f39d802 tempest-VolumesSnapshotTestJSON-246952173 None] Created reservations ['bdd08fa8-5851-497f-92cd-b2422b7ca4de', 'b7df6539-75c0-42c4-9b34-1de15faaf788', '6a4cc940-fb5f-41f4-b111-7692cfb218a2', '6a6e512d-4111-4518-b1e0-e6ec4f3dd17d'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:32 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-4b84cf4b-3bf2-47d8-9e61-85979f39d802 tempest-VolumesSnapshotTestJSON-246952173 None] Delete snapshot completed successfully. Feb 27 12:31:32 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4b84cf4b-3bf2-47d8-9e61-85979f39d802 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-01e65f6d-f206-49c1-bd21-8f51dc4d2118-delete_snapshot" released by "delete_snapshot" :: held 2.260s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:32 devstack sudo[87133]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0 1073741824" returned: 0 in 0.472s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:32 devstack sudo[87139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0 Feb 27 12:31:32 devstack sudo[87139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:33 devstack sudo[87139]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0" returned: 0 in 0.397s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:33 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:31:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:33 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e3ca568-c979-4a11-aa85-ee747c72f0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:33 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c69d8ca-d3b6-4741-adfe-8fe100678e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:33 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Volume volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0 (173fb169-0dee-4f1b-bb80-dacef86ea2b0): created successfully Feb 27 12:31:33 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c69d8ca-d3b6-4741-adfe-8fe100678e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:33 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Flow 'volume_create_manager' (5c690d91-7a40-4021-87e7-689542fee60d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:33 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-8b436b20-83d4-43cc-b41e-ad4fc135a1b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Created volume successfully. Feb 27 12:31:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d39b877b-dcf1-4396-a253-818195fc1948 tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d39b877b-dcf1-4396-a253-818195fc1948 tempest-VolumesDeleteCascade-1708497653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:33 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-d39b877b-dcf1-4396-a253-818195fc1948 tempest-VolumesDeleteCascade-1708497653 None] Creating offline snapshot b10c1560-fa6f-4d1a-8edb-af7975cf3325 of volume 94736cb6-94d0-4cab-bfa3-e6da368ec7f9 {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:31:33 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[019f3eb9-6d49-42db-b6b9-3b9556be3c5c]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d39b877b-dcf1-4396-a253-818195fc1948 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:33 devstack sudo[87143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e Feb 27 12:31:33 devstack sudo[87143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:33 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-298b781a-34ea-42b1-8bb8-056f68cd4127 tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "cinder-c7cb7922-01a4-424c-9fab-e51d53660214-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:33 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-298b781a-34ea-42b1-8bb8-056f68cd4127 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-c7cb7922-01a4-424c-9fab-e51d53660214-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:33 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-298b781a-34ea-42b1-8bb8-056f68cd4127 tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "cinder-quobyte-c7cb7922-01a4-424c-9fab-e51d53660214" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:33 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-298b781a-34ea-42b1-8bb8-056f68cd4127 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-c7cb7922-01a4-424c-9fab-e51d53660214" acquired by "delete_volume" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:33 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac51e00a-2fd7-45c2-9f66-8e03bb650bca]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-298b781a-34ea-42b1-8bb8-056f68cd4127 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:33 devstack sudo[87145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214 Feb 27 12:31:33 devstack sudo[87145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:33 devstack sudo[87143]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d39b877b-dcf1-4396-a253-818195fc1948 tempest-VolumesDeleteCascade-1708497653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e" returned: 0 in 0.512s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:33 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-d39b877b-dcf1-4396-a253-818195fc1948 tempest-VolumesDeleteCascade-1708497653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:31:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d39b877b-dcf1-4396-a253-818195fc1948 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.b10c1560-fa6f-4d1a-8edb-af7975cf3325 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:33 devstack sudo[87150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.b10c1560-fa6f-4d1a-8edb-af7975cf3325 1G Feb 27 12:31:33 devstack sudo[87150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:34 devstack sudo[87145]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-298b781a-34ea-42b1-8bb8-056f68cd4127 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214" returned: 0 in 0.619s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-298b781a-34ea-42b1-8bb8-056f68cd4127 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:34 devstack sudo[87179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214 Feb 27 12:31:34 devstack sudo[87179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a19666c0-59d9-4398-b685-e7e092da15fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:34 devstack sudo[87150]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d39b877b-dcf1-4396-a253-818195fc1948 tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.b10c1560-fa6f-4d1a-8edb-af7975cf3325 1G" returned: 0 in 0.837s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d39b877b-dcf1-4396-a253-818195fc1948 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.b10c1560-fa6f-4d1a-8edb-af7975cf3325 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:34 devstack sudo[87187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.b10c1560-fa6f-4d1a-8edb-af7975cf3325 Feb 27 12:31:34 devstack sudo[87187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:34 devstack sudo[87179]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-298b781a-34ea-42b1-8bb8-056f68cd4127 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c7cb7922-01a4-424c-9fab-e51d53660214" returned: 0 in 0.619s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:34 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-298b781a-34ea-42b1-8bb8-056f68cd4127 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-c7cb7922-01a4-424c-9fab-e51d53660214" released by "delete_volume" :: held 1.275s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:34 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-298b781a-34ea-42b1-8bb8-056f68cd4127 tempest-VolumesSnapshotTestJSON-246952173 None] Created reservations ['e281a5ac-edb6-464b-bb2d-823e02b51cee', 'a0aa883b-b67a-45a7-a1ce-1a1c0f79ebe9', '87bf4cf7-3a76-41d7-af20-35ff92287d30', '027b3045-acb4-467b-be45-14987871036a'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-298b781a-34ea-42b1-8bb8-056f68cd4127 tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-298b781a-34ea-42b1-8bb8-056f68cd4127 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:34 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-298b781a-34ea-42b1-8bb8-056f68cd4127 tempest-VolumesSnapshotTestJSON-246952173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:34 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-298b781a-34ea-42b1-8bb8-056f68cd4127 tempest-VolumesSnapshotTestJSON-246952173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-298b781a-34ea-42b1-8bb8-056f68cd4127 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-298b781a-34ea-42b1-8bb8-056f68cd4127 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:34 devstack sudo[87189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:31:34 devstack sudo[87189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:35 devstack sudo[87187]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d39b877b-dcf1-4396-a253-818195fc1948 tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.b10c1560-fa6f-4d1a-8edb-af7975cf3325" returned: 0 in 0.532s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:35 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-d39b877b-dcf1-4396-a253-818195fc1948 tempest-VolumesDeleteCascade-1708497653 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.b10c1560-fa6f-4d1a-8edb-af7975cf3325 is being set with open permissions: ugo+rw Feb 27 12:31:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d39b877b-dcf1-4396-a253-818195fc1948 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.b10c1560-fa6f-4d1a-8edb-af7975cf3325 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:35 devstack sudo[87195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.b10c1560-fa6f-4d1a-8edb-af7975cf3325 Feb 27 12:31:35 devstack sudo[87195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:35 devstack sudo[87189]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-298b781a-34ea-42b1-8bb8-056f68cd4127 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.443s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:35 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-298b781a-34ea-42b1-8bb8-056f68cd4127 tempest-VolumesSnapshotTestJSON-246952173 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:31:35 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-298b781a-34ea-42b1-8bb8-056f68cd4127 tempest-VolumesSnapshotTestJSON-246952173 None] Deleted volume successfully. Feb 27 12:31:35 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-298b781a-34ea-42b1-8bb8-056f68cd4127 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-c7cb7922-01a4-424c-9fab-e51d53660214-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:35 devstack sudo[87195]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d39b877b-dcf1-4396-a253-818195fc1948 tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.b10c1560-fa6f-4d1a-8edb-af7975cf3325" returned: 0 in 0.403s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d39b877b-dcf1-4396-a253-818195fc1948 tempest-VolumesDeleteCascade-1708497653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.341s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a19666c0-59d9-4398-b685-e7e092da15fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.293s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:35 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-a19666c0-59d9-4398-b685-e7e092da15fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Creating offline snapshot 173621ff-73b0-400a-80c8-bb5af01fc497 of volume 173fb169-0dee-4f1b-bb80-dacef86ea2b0 {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:31:35 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-d39b877b-dcf1-4396-a253-818195fc1948 tempest-VolumesDeleteCascade-1708497653 None] Create snapshot completed successfully Feb 27 12:31:35 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b9f845-542d-4058-bafa-b824590828e2]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a19666c0-59d9-4398-b685-e7e092da15fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:35 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-c00d97fc-e6f3-4e7c-9c2e-4f9bf0c27111 tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "cinder-782fb295-f88d-4f75-9a68-36912c536a5d-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:35 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-c00d97fc-e6f3-4e7c-9c2e-4f9bf0c27111 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-782fb295-f88d-4f75-9a68-36912c536a5d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:35 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-c00d97fc-e6f3-4e7c-9c2e-4f9bf0c27111 tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "cinder-quobyte-782fb295-f88d-4f75-9a68-36912c536a5d" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:35 devstack sudo[87199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0 Feb 27 12:31:35 devstack sudo[87199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:35 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-c00d97fc-e6f3-4e7c-9c2e-4f9bf0c27111 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-782fb295-f88d-4f75-9a68-36912c536a5d" acquired by "delete_volume" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:35 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[affe8d2a-3717-46f2-a96a-dd69f2473715]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c00d97fc-e6f3-4e7c-9c2e-4f9bf0c27111 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:35 devstack sudo[87201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d Feb 27 12:31:35 devstack sudo[87201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:36 devstack sudo[87199]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a19666c0-59d9-4398-b685-e7e092da15fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0" returned: 0 in 0.699s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a19666c0-59d9-4398-b685-e7e092da15fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0.173621ff-73b0-400a-80c8-bb5af01fc497 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:36 devstack sudo[87209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0.173621ff-73b0-400a-80c8-bb5af01fc497 1G Feb 27 12:31:36 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "cinder-94736cb6-94d0-4cab-bfa3-e6da368ec7f9-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-94736cb6-94d0-4cab-bfa3-e6da368ec7f9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:36 devstack sudo[87201]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c00d97fc-e6f3-4e7c-9c2e-4f9bf0c27111 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d" returned: 0 in 0.722s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c00d97fc-e6f3-4e7c-9c2e-4f9bf0c27111 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:36 devstack sudo[87211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d Feb 27 12:31:36 devstack sudo[87211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:36 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Performing cascade delete. {{(pid=83077) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Feb 27 12:31:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "cinder-6f6d6a2f-2709-4103-bae8-8338d68d3b3e-delete_snapshot" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-6f6d6a2f-2709-4103-bae8-8338d68d3b3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "cinder-quobyte-94736cb6-94d0-4cab-bfa3-e6da368ec7f9" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-quobyte-94736cb6-94d0-4cab-bfa3-e6da368ec7f9" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "cinder-quobyte-6f6d6a2f-2709-4103-bae8-8338d68d3b3e" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-quobyte-6f6d6a2f-2709-4103-bae8-8338d68d3b3e" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:36 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Deleting offline snapshot 6f6d6a2f-2709-4103-bae8-8338d68d3b3e of volume 94736cb6-94d0-4cab-bfa3-e6da368ec7f9 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:31:36 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] snapshot_file for this snap is: volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:31:36 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9910b3b9-d09d-4fb5-9fbd-ae3af9db84c7]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:36 devstack sudo[87213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e Feb 27 12:31:36 devstack sudo[87213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:37 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a19666c0-59d9-4398-b685-e7e092da15fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0.173621ff-73b0-400a-80c8-bb5af01fc497 1G" returned: 0 in 0.584s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a19666c0-59d9-4398-b685-e7e092da15fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0.173621ff-73b0-400a-80c8-bb5af01fc497 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:37 devstack sudo[87219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0.173621ff-73b0-400a-80c8-bb5af01fc497 Feb 27 12:31:37 devstack sudo[87219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:37 devstack sudo[87211]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c00d97fc-e6f3-4e7c-9c2e-4f9bf0c27111 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-782fb295-f88d-4f75-9a68-36912c536a5d" returned: 0 in 0.523s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:37 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-c00d97fc-e6f3-4e7c-9c2e-4f9bf0c27111 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-quobyte-782fb295-f88d-4f75-9a68-36912c536a5d" released by "delete_volume" :: held 1.290s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:37 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-c00d97fc-e6f3-4e7c-9c2e-4f9bf0c27111 tempest-VolumesSnapshotTestJSON-246952173 None] Created reservations ['0116d09d-a5ad-48c2-9d0b-5b79beb6bafa', 'fd134f8c-1165-4f11-a336-1dd70f33c22a', '83ef658f-1ce9-4067-9c0b-a0e43d8d6868', 'd38069d8-faeb-4f51-9197-17fc194059bc'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c00d97fc-e6f3-4e7c-9c2e-4f9bf0c27111 tempest-VolumesSnapshotTestJSON-246952173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c00d97fc-e6f3-4e7c-9c2e-4f9bf0c27111 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:37 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c00d97fc-e6f3-4e7c-9c2e-4f9bf0c27111 tempest-VolumesSnapshotTestJSON-246952173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:37 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c00d97fc-e6f3-4e7c-9c2e-4f9bf0c27111 tempest-VolumesSnapshotTestJSON-246952173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c00d97fc-e6f3-4e7c-9c2e-4f9bf0c27111 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c00d97fc-e6f3-4e7c-9c2e-4f9bf0c27111 tempest-VolumesSnapshotTestJSON-246952173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:37 devstack sudo[87224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:31:37 devstack sudo[87224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:37 devstack sudo[87213]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e" returned: 0 in 0.674s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:37 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:31:37 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[007a32c5-5c6f-4fd5-953b-4f3e3d15e8b0]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:37 devstack sudo[87226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9 Feb 27 12:31:37 devstack sudo[87226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:37 devstack sudo[87219]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a19666c0-59d9-4398-b685-e7e092da15fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0.173621ff-73b0-400a-80c8-bb5af01fc497" returned: 0 in 0.553s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:37 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-a19666c0-59d9-4398-b685-e7e092da15fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0.173621ff-73b0-400a-80c8-bb5af01fc497 is being set with open permissions: ugo+rw Feb 27 12:31:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a19666c0-59d9-4398-b685-e7e092da15fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0.173621ff-73b0-400a-80c8-bb5af01fc497 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:37 devstack sudo[87231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0.173621ff-73b0-400a-80c8-bb5af01fc497 Feb 27 12:31:37 devstack sudo[87231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:37 devstack sudo[87224]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c00d97fc-e6f3-4e7c-9c2e-4f9bf0c27111 tempest-VolumesSnapshotTestJSON-246952173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.700s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:37 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-c00d97fc-e6f3-4e7c-9c2e-4f9bf0c27111 tempest-VolumesSnapshotTestJSON-246952173 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:31:37 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-c00d97fc-e6f3-4e7c-9c2e-4f9bf0c27111 tempest-VolumesSnapshotTestJSON-246952173 None] Deleted volume successfully. Feb 27 12:31:37 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-c00d97fc-e6f3-4e7c-9c2e-4f9bf0c27111 tempest-VolumesSnapshotTestJSON-246952173 None] Lock "cinder-782fb295-f88d-4f75-9a68-36912c536a5d-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:38 devstack sudo[87231]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a19666c0-59d9-4398-b685-e7e092da15fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0.173621ff-73b0-400a-80c8-bb5af01fc497" returned: 0 in 0.539s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a19666c0-59d9-4398-b685-e7e092da15fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:38 devstack sudo[87238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0.info Feb 27 12:31:38 devstack sudo[87238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:38 devstack sudo[87226]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9" returned: 0 in 0.843s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:38 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[be95f1f1-0a4c-40ca-aeec-5caee011f65b]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.b10c1560-fa6f-4d1a-8edb-af7975cf3325 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:38 devstack sudo[87240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.b10c1560-fa6f-4d1a-8edb-af7975cf3325 Feb 27 12:31:38 devstack sudo[87240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:38 devstack sudo[87238]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a19666c0-59d9-4398-b685-e7e092da15fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0.info" returned: 0 in 0.575s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:38 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-a19666c0-59d9-4398-b685-e7e092da15fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0.info is being set with open permissions: ugo+rw Feb 27 12:31:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a19666c0-59d9-4398-b685-e7e092da15fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:38 devstack sudo[87249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0.info Feb 27 12:31:38 devstack sudo[87249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:38 devstack sudo[87240]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.b10c1560-fa6f-4d1a-8edb-af7975cf3325" returned: 0 in 0.742s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:38 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:31:39 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[91791b37-42df-4474-a251-a3cb79efcc89]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:39 devstack sudo[87269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e Feb 27 12:31:39 devstack sudo[87269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:39 devstack sudo[87249]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a19666c0-59d9-4398-b685-e7e092da15fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0.info" returned: 0 in 0.638s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a19666c0-59d9-4398-b685-e7e092da15fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.661s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:39 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-a19666c0-59d9-4398-b685-e7e092da15fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Create snapshot completed successfully Feb 27 12:31:39 devstack sudo[87269]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e" returned: 0 in 0.730s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:39 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:31:39 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[39dd71d5-5f5a-413a-b4f5-4f184d7cd958]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:39 devstack sudo[87297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9 Feb 27 12:31:39 devstack sudo[87297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:40 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d431c1a7-0600-4e17-8512-2ea71d6724fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Acquiring lock "cinder-173621ff-73b0-400a-80c8-bb5af01fc497-delete_snapshot" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:40 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d431c1a7-0600-4e17-8512-2ea71d6724fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Lock "cinder-173621ff-73b0-400a-80c8-bb5af01fc497-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:40 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d431c1a7-0600-4e17-8512-2ea71d6724fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Acquiring lock "cinder-quobyte-173fb169-0dee-4f1b-bb80-dacef86ea2b0" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:40 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d431c1a7-0600-4e17-8512-2ea71d6724fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Lock "cinder-quobyte-173fb169-0dee-4f1b-bb80-dacef86ea2b0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:40 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d431c1a7-0600-4e17-8512-2ea71d6724fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Acquiring lock "cinder-quobyte-173621ff-73b0-400a-80c8-bb5af01fc497" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:40 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d431c1a7-0600-4e17-8512-2ea71d6724fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Lock "cinder-quobyte-173621ff-73b0-400a-80c8-bb5af01fc497" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:40 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-d431c1a7-0600-4e17-8512-2ea71d6724fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Deleting offline snapshot 173621ff-73b0-400a-80c8-bb5af01fc497 of volume 173fb169-0dee-4f1b-bb80-dacef86ea2b0 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:31:40 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-d431c1a7-0600-4e17-8512-2ea71d6724fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] snapshot_file for this snap is: volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0.173621ff-73b0-400a-80c8-bb5af01fc497 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:31:40 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[8305114d-2142-4a38-afde-1616442c30cb]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d431c1a7-0600-4e17-8512-2ea71d6724fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0.173621ff-73b0-400a-80c8-bb5af01fc497 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:40 devstack sudo[87300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0.173621ff-73b0-400a-80c8-bb5af01fc497 Feb 27 12:31:40 devstack sudo[87300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:40 devstack sudo[87297]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9" returned: 0 in 1.112s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:40 devstack sudo[87307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e Feb 27 12:31:40 devstack sudo[87307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:41 devstack sudo[87300]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d431c1a7-0600-4e17-8512-2ea71d6724fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0.173621ff-73b0-400a-80c8-bb5af01fc497" returned: 0 in 1.099s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:41 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-d431c1a7-0600-4e17-8512-2ea71d6724fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:31:41 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[676ce561-e9ea-498c-a10a-dbf7dbc1f03f]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d431c1a7-0600-4e17-8512-2ea71d6724fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:41 devstack sudo[87314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0 Feb 27 12:31:41 devstack sudo[87314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:41 devstack sudo[87307]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e" returned: 0 in 0.785s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:41 devstack sudo[87319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e Feb 27 12:31:41 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:41 devstack sudo[87314]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d431c1a7-0600-4e17-8512-2ea71d6724fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0" returned: 0 in 0.716s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d431c1a7-0600-4e17-8512-2ea71d6724fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0.173621ff-73b0-400a-80c8-bb5af01fc497 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:41 devstack sudo[87328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0.173621ff-73b0-400a-80c8-bb5af01fc497 Feb 27 12:31:41 devstack sudo[87328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:42 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.6f6d6a2f-2709-4103-bae8-8338d68d3b3e" returned: 0 in 0.595s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.b10c1560-fa6f-4d1a-8edb-af7975cf3325 -F qcow2 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:42 devstack sudo[87349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.b10c1560-fa6f-4d1a-8edb-af7975cf3325 -F qcow2 Feb 27 12:31:42 devstack sudo[87349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:42 devstack sudo[87328]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d431c1a7-0600-4e17-8512-2ea71d6724fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0.173621ff-73b0-400a-80c8-bb5af01fc497" returned: 0 in 0.587s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d431c1a7-0600-4e17-8512-2ea71d6724fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0.173621ff-73b0-400a-80c8-bb5af01fc497 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:42 devstack sudo[87354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0.173621ff-73b0-400a-80c8-bb5af01fc497 Feb 27 12:31:42 devstack sudo[87354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:42 devstack sudo[87349]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.b10c1560-fa6f-4d1a-8edb-af7975cf3325 -F qcow2" returned: 0 in 0.547s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:42 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-quobyte-6f6d6a2f-2709-4103-bae8-8338d68d3b3e" released by "_delete_snapshot" :: held 6.144s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:42 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-quobyte-94736cb6-94d0-4cab-bfa3-e6da368ec7f9" released by "delete_snapshot" :: held 6.158s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:42 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Created reservations ['8a7cdc29-22a9-4384-abbf-24aae7cd5c0b', 'dd21a79e-11fc-4a7c-ba22-89d08e801bef', 'a790c801-ef0a-4c5d-b013-9f5de9314765', 'd6152b1f-5f47-4d72-8e10-e6b64a21777a'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:42 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Delete snapshot completed successfully. Feb 27 12:31:42 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-6f6d6a2f-2709-4103-bae8-8338d68d3b3e-delete_snapshot" released by "delete_snapshot" :: held 6.273s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:42 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "cinder-b10c1560-fa6f-4d1a-8edb-af7975cf3325-delete_snapshot" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:42 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-b10c1560-fa6f-4d1a-8edb-af7975cf3325-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:42 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "cinder-quobyte-94736cb6-94d0-4cab-bfa3-e6da368ec7f9" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:42 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-quobyte-94736cb6-94d0-4cab-bfa3-e6da368ec7f9" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:42 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "cinder-quobyte-b10c1560-fa6f-4d1a-8edb-af7975cf3325" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:42 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-quobyte-b10c1560-fa6f-4d1a-8edb-af7975cf3325" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:42 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Deleting offline snapshot b10c1560-fa6f-4d1a-8edb-af7975cf3325 of volume 94736cb6-94d0-4cab-bfa3-e6da368ec7f9 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:31:42 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] snapshot_file for this snap is: volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.b10c1560-fa6f-4d1a-8edb-af7975cf3325 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:31:42 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4adf1ff-614e-46ba-b98c-450e7e6d4ebf]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.b10c1560-fa6f-4d1a-8edb-af7975cf3325 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:42 devstack sudo[87354]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d431c1a7-0600-4e17-8512-2ea71d6724fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0.173621ff-73b0-400a-80c8-bb5af01fc497" returned: 0 in 0.458s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:43 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d431c1a7-0600-4e17-8512-2ea71d6724fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Lock "cinder-quobyte-173621ff-73b0-400a-80c8-bb5af01fc497" released by "_delete_snapshot" :: held 2.943s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:43 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d431c1a7-0600-4e17-8512-2ea71d6724fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Lock "cinder-quobyte-173fb169-0dee-4f1b-bb80-dacef86ea2b0" released by "delete_snapshot" :: held 2.955s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:43 devstack sudo[87362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.b10c1560-fa6f-4d1a-8edb-af7975cf3325 Feb 27 12:31:43 devstack sudo[87362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:43 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-d431c1a7-0600-4e17-8512-2ea71d6724fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Created reservations ['9521d697-ad61-4d84-9f73-a8425387ee12', '8eff0840-39b2-4a6c-b76f-fcd980bf83d1', 'a98f322f-4c50-4c86-8e94-cbebcd24b74c', 'f5b846fb-1258-408e-91d2-173327ea74a7'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:43 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-d431c1a7-0600-4e17-8512-2ea71d6724fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Delete snapshot completed successfully. Feb 27 12:31:43 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d431c1a7-0600-4e17-8512-2ea71d6724fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Lock "cinder-173621ff-73b0-400a-80c8-bb5af01fc497-delete_snapshot" released by "delete_snapshot" :: held 3.066s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:43 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-814df251-9557-4958-b1ea-64aedd2e11be tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Acquiring lock "cinder-173fb169-0dee-4f1b-bb80-dacef86ea2b0-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:43 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-814df251-9557-4958-b1ea-64aedd2e11be tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Lock "cinder-173fb169-0dee-4f1b-bb80-dacef86ea2b0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:43 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-814df251-9557-4958-b1ea-64aedd2e11be tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Acquiring lock "cinder-quobyte-173fb169-0dee-4f1b-bb80-dacef86ea2b0" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:43 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-814df251-9557-4958-b1ea-64aedd2e11be tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Lock "cinder-quobyte-173fb169-0dee-4f1b-bb80-dacef86ea2b0" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:43 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c9748d-a86a-4917-812e-0338c3679087]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-814df251-9557-4958-b1ea-64aedd2e11be tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:43 devstack sudo[87364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0 Feb 27 12:31:43 devstack sudo[87364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:43 devstack sudo[87362]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.b10c1560-fa6f-4d1a-8edb-af7975cf3325" returned: 0 in 0.619s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:43 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:31:43 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[161e3d83-debb-42c2-b011-4f960e8afedc]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:43 devstack sudo[87369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9 Feb 27 12:31:43 devstack sudo[87369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:43 devstack sudo[87364]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-814df251-9557-4958-b1ea-64aedd2e11be tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0" returned: 0 in 0.582s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-814df251-9557-4958-b1ea-64aedd2e11be tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:43 devstack sudo[87375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0 Feb 27 12:31:43 devstack sudo[87375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Flow 'volume_create_manager' (38a9473a-5304-454d-b291-381d4a443424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cfac555-7284-41ac-92e3-2f7edc58f7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cfac555-7284-41ac-92e3-2f7edc58f7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1982828688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d21b1fa2-4790-43f4-aa3e-c266617653ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2bcfafb085d4cd6ab978493a515471a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:44Z,use_quota=True,user_id='814d72d0e9d94c63be3647315dffe8d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92120fbd-b4b0-4776-8cbd-90853f8bd053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92120fbd-b4b0-4776-8cbd-90853f8bd053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (908680ff-c83f-401c-998e-31b4812cd9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (908680ff-c83f-401c-998e-31b4812cd9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd21b1fa2-4790-43f4-aa3e-c266617653ca', 'volume_name': 'volume-d21b1fa2-4790-43f4-aa3e-c266617653ca', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e4cff1-f5a9-4775-a905-9c2ba66d38e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e4cff1-f5a9-4775-a905-9c2ba66d38e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a89861-f0fe-47f0-a745-c39e2ca39966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:44 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Volume d21b1fa2-4790-43f4-aa3e-c266617653ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d21b1fa2-4790-43f4-aa3e-c266617653ca', 'volume_size': 1} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1982828688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d21b1fa2-4790-43f4-aa3e-c266617653ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2bcfafb085d4cd6ab978493a515471a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:44Z,use_quota=True,user_id='814d72d0e9d94c63be3647315dffe8d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Creating volume d21b1fa2-4790-43f4-aa3e-c266617653ca {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:44 devstack sudo[87369]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:31:44 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9" returned: 0 in 0.607s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.b10c1560-fa6f-4d1a-8edb-af7975cf3325 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:44 devstack sudo[87380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca 1073741824 Feb 27 12:31:44 devstack sudo[87380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:44 devstack sudo[87382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.b10c1560-fa6f-4d1a-8edb-af7975cf3325 Feb 27 12:31:44 devstack sudo[87382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:44 devstack sudo[87375]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-814df251-9557-4958-b1ea-64aedd2e11be tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-173fb169-0dee-4f1b-bb80-dacef86ea2b0" returned: 0 in 0.459s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-814df251-9557-4958-b1ea-64aedd2e11be tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Lock "cinder-quobyte-173fb169-0dee-4f1b-bb80-dacef86ea2b0" released by "delete_volume" :: held 1.071s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-814df251-9557-4958-b1ea-64aedd2e11be tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Created reservations ['097178af-e879-4886-992b-eb294bf675dc', '70223981-b9f5-4ed7-8fb5-89c63760dde5', '74b53e75-6a0d-4117-889e-17bb17682073', 'a2306096-c2ff-4292-bcdd-e88ea989e61a'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-814df251-9557-4958-b1ea-64aedd2e11be tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-814df251-9557-4958-b1ea-64aedd2e11be tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-814df251-9557-4958-b1ea-64aedd2e11be tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-814df251-9557-4958-b1ea-64aedd2e11be tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-814df251-9557-4958-b1ea-64aedd2e11be tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-814df251-9557-4958-b1ea-64aedd2e11be tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:44 devstack sudo[87385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:31:44 devstack sudo[87385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:44 devstack sudo[87382]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.b10c1560-fa6f-4d1a-8edb-af7975cf3325" returned: 0 in 0.470s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.b10c1560-fa6f-4d1a-8edb-af7975cf3325 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:44 devstack sudo[87380]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca 1073741824" returned: 0 in 0.505s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:44 devstack sudo[87393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.b10c1560-fa6f-4d1a-8edb-af7975cf3325 Feb 27 12:31:44 devstack sudo[87393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:44 devstack cinder-volume[83077]: INFO cinder.volume.manager [req-ecad0dbe-2121-423d-840b-c2afafe8a436 req-0a781698-6748-42fb-935e-9cdb0dff9476 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Terminate volume connection completed successfully. Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-ecad0dbe-2121-423d-840b-c2afafe8a436 req-0a781698-6748-42fb-935e-9cdb0dff9476 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Deleting attachment bc1becd1-1c9d-435f-b6ce-845e7e4f41da. {{(pid=83077) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 27 12:31:44 devstack sudo[87395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca Feb 27 12:31:44 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:44 devstack sudo[87385]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-814df251-9557-4958-b1ea-64aedd2e11be tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.436s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-814df251-9557-4958-b1ea-64aedd2e11be tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:31:44 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-814df251-9557-4958-b1ea-64aedd2e11be tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Deleted volume successfully. Feb 27 12:31:44 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-814df251-9557-4958-b1ea-64aedd2e11be tempest-VolumeSnapshotQuotasNegativeTestJSON-1855327961 None] Lock "cinder-173fb169-0dee-4f1b-bb80-dacef86ea2b0-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:45 devstack sudo[87393]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9.b10c1560-fa6f-4d1a-8edb-af7975cf3325" returned: 0 in 0.482s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:45 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-quobyte-b10c1560-fa6f-4d1a-8edb-af7975cf3325" released by "_delete_snapshot" :: held 2.229s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:45 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-quobyte-94736cb6-94d0-4cab-bfa3-e6da368ec7f9" released by "delete_snapshot" :: held 2.241s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:45 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca" returned: 0 in 0.482s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:45 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:31:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a89861-f0fe-47f0-a745-c39e2ca39966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d21b1fa2-4790-43f4-aa3e-c266617653ca', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82716e36-a3b6-454b-864e-5fd63a738ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:45 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Created reservations ['991d0a45-16f2-4d57-84f3-65d63e7ee385', '326f14b1-9257-420c-995f-849c41cd2364', '8c47b8fc-7d01-4476-b04f-3fd1685c7107', 'c5105f22-9a9f-4e95-bc81-744575e1fa1d'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:45 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Volume volume-d21b1fa2-4790-43f4-aa3e-c266617653ca (d21b1fa2-4790-43f4-aa3e-c266617653ca): created successfully Feb 27 12:31:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82716e36-a3b6-454b-864e-5fd63a738ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Flow 'volume_create_manager' (38a9473a-5304-454d-b291-381d4a443424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:45 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-00aa892f-a34f-4434-9d66-6518b0893e7f tempest-VolumesSnapshotListTestJSON-392029018 None] Created volume successfully. Feb 27 12:31:45 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Delete snapshot completed successfully. Feb 27 12:31:45 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-b10c1560-fa6f-4d1a-8edb-af7975cf3325-delete_snapshot" released by "delete_snapshot" :: held 2.389s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Snapshots deleted, issuing volume delete {{(pid=83077) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Feb 27 12:31:45 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "cinder-quobyte-94736cb6-94d0-4cab-bfa3-e6da368ec7f9" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:45 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-quobyte-94736cb6-94d0-4cab-bfa3-e6da368ec7f9" acquired by "delete_volume" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:45 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6aac42-c997-47ac-86d1-e76c957cb774]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:45 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-ecad0dbe-2121-423d-840b-c2afafe8a436 req-a15c596a-b988-4ba3-8c04-037e31ac9cd1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Acquiring lock "cinder-12113f0f-f609-4278-866a-dd60fc600792-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:45 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-ecad0dbe-2121-423d-840b-c2afafe8a436 req-a15c596a-b988-4ba3-8c04-037e31ac9cd1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Lock "cinder-12113f0f-f609-4278-866a-dd60fc600792-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:45 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-ecad0dbe-2121-423d-840b-c2afafe8a436 req-a15c596a-b988-4ba3-8c04-037e31ac9cd1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Acquiring lock "cinder-quobyte-12113f0f-f609-4278-866a-dd60fc600792" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:45 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-ecad0dbe-2121-423d-840b-c2afafe8a436 req-a15c596a-b988-4ba3-8c04-037e31ac9cd1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Lock "cinder-quobyte-12113f0f-f609-4278-866a-dd60fc600792" acquired by "delete_volume" :: waited 0.007s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:45 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec0858b-5ff6-4d7d-858d-0b8156189e20]: (4, 'raw') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-ecad0dbe-2121-423d-840b-c2afafe8a436 req-a15c596a-b988-4ba3-8c04-037e31ac9cd1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:45 devstack sudo[87400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9 Feb 27 12:31:45 devstack sudo[87400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:45 devstack sudo[87402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792 Feb 27 12:31:45 devstack sudo[87402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:45 devstack sudo[87400]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9" returned: 0 in 0.544s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:45 devstack sudo[87408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9 Feb 27 12:31:45 devstack sudo[87408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:46 devstack sudo[87402]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-ecad0dbe-2121-423d-840b-c2afafe8a436 req-a15c596a-b988-4ba3-8c04-037e31ac9cd1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792" returned: 0 in 0.570s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-ecad0dbe-2121-423d-840b-c2afafe8a436 req-a15c596a-b988-4ba3-8c04-037e31ac9cd1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:46 devstack sudo[87411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792 Feb 27 12:31:46 devstack sudo[87411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-90600831-50a0-4067-a2be-d08dc5c110eb tempest-VolumesSnapshotListTestJSON-392029018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-90600831-50a0-4067-a2be-d08dc5c110eb tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:46 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-90600831-50a0-4067-a2be-d08dc5c110eb tempest-VolumesSnapshotListTestJSON-392029018 None] Creating offline snapshot 88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4 of volume d21b1fa2-4790-43f4-aa3e-c266617653ca {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:31:46 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7175be-3e7f-4187-8966-06b058b006d3]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-90600831-50a0-4067-a2be-d08dc5c110eb tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:46 devstack sudo[87408]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-94736cb6-94d0-4cab-bfa3-e6da368ec7f9" returned: 0 in 0.597s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:46 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-quobyte-94736cb6-94d0-4cab-bfa3-e6da368ec7f9" released by "delete_volume" :: held 1.172s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:46 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Created reservations ['3b6894ed-5e5b-4d3a-8e90-9d6798d637aa', 'ac284657-6c27-4bb2-9894-c9e3bd0f999e', '18d3f20b-0989-4a5b-867c-953d1e5ca615', 'aadffc3e-c319-4a30-a643-2cebfd1c5a29'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:46 devstack sudo[87414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca Feb 27 12:31:46 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:46 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:46 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:46 devstack sudo[87411]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-ecad0dbe-2121-423d-840b-c2afafe8a436 req-a15c596a-b988-4ba3-8c04-037e31ac9cd1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792" returned: 1 in 0.582s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-ecad0dbe-2121-423d-840b-c2afafe8a436 req-a15c596a-b988-4ba3-8c04-037e31ac9cd1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792' failed. Not Retrying. {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:31:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-ecad0dbe-2121-423d-840b-c2afafe8a436 req-a15c596a-b988-4ba3-8c04-037e31ac9cd1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:46 devstack sudo[87419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:31:46 devstack sudo[87419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:46 devstack sudo[87420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792 Feb 27 12:31:46 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:47 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-ecad0dbe-2121-423d-840b-c2afafe8a436 req-a15c596a-b988-4ba3-8c04-037e31ac9cd1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12113f0f-f609-4278-866a-dd60fc600792" returned: 0 in 0.417s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-ecad0dbe-2121-423d-840b-c2afafe8a436 req-a15c596a-b988-4ba3-8c04-037e31ac9cd1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Lock "cinder-quobyte-12113f0f-f609-4278-866a-dd60fc600792" released by "delete_volume" :: held 1.616s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG cinder.quota [req-ecad0dbe-2121-423d-840b-c2afafe8a436 req-a15c596a-b988-4ba3-8c04-037e31ac9cd1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Created reservations ['ab55bf32-ac7d-44c8-aab1-bd9f3eef1533', 'c3d3e912-2ad5-4038-9e43-4261065f396c', 'a5756448-72fd-474c-a38f-bbcb5d5b50b6', 'dcdf8ec8-c8bb-41f2-ba2f-9a3afb788dbd'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-ecad0dbe-2121-423d-840b-c2afafe8a436 req-a15c596a-b988-4ba3-8c04-037e31ac9cd1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-ecad0dbe-2121-423d-840b-c2afafe8a436 req-a15c596a-b988-4ba3-8c04-037e31ac9cd1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-ecad0dbe-2121-423d-840b-c2afafe8a436 req-a15c596a-b988-4ba3-8c04-037e31ac9cd1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-ecad0dbe-2121-423d-840b-c2afafe8a436 req-a15c596a-b988-4ba3-8c04-037e31ac9cd1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-ecad0dbe-2121-423d-840b-c2afafe8a436 req-a15c596a-b988-4ba3-8c04-037e31ac9cd1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-ecad0dbe-2121-423d-840b-c2afafe8a436 req-a15c596a-b988-4ba3-8c04-037e31ac9cd1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:47 devstack sudo[87428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:31:47 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:47 devstack sudo[87419]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.592s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:31:47 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Deleted volume successfully. Feb 27 12:31:47 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31b553d9-a74d-4222-aa91-809270a66e71 tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-94736cb6-94d0-4cab-bfa3-e6da368ec7f9-delete_volume" released by "delete_volume" :: held 10.637s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-90600831-50a0-4067-a2be-d08dc5c110eb tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca" returned: 0 in 0.762s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-90600831-50a0-4067-a2be-d08dc5c110eb tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:47 devstack sudo[87430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4 1G Feb 27 12:31:47 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:47 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-ecad0dbe-2121-423d-840b-c2afafe8a436 req-a15c596a-b988-4ba3-8c04-037e31ac9cd1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.506s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG cinder.manager [req-ecad0dbe-2121-423d-840b-c2afafe8a436 req-a15c596a-b988-4ba3-8c04-037e31ac9cd1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:31:47 devstack cinder-volume[83077]: INFO cinder.volume.manager [req-ecad0dbe-2121-423d-840b-c2afafe8a436 req-a15c596a-b988-4ba3-8c04-037e31ac9cd1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Deleted volume successfully. Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-ecad0dbe-2121-423d-840b-c2afafe8a436 req-a15c596a-b988-4ba3-8c04-037e31ac9cd1 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Lock "cinder-12113f0f-f609-4278-866a-dd60fc600792-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Flow 'volume_create_manager' (26350e88-046d-4c92-9161-52ca5f96f782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f796c1b2-c7c3-49e0-af5c-cd15b25dc435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f796c1b2-c7c3-49e0-af5c-cd15b25dc435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-514164171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaea6187-ea9d-4119-a2d4-1111acf054d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc300440c7c4b3db3dddb2c06990970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:48Z,use_quota=True,user_id='6b19d90c41bc429b988af5d679374036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:47 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1ce852-093e-4daa-9a10-53ba63ad2fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1ce852-093e-4daa-9a10-53ba63ad2fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f459e628-ad57-436d-97b5-e8f52cd67fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f459e628-ad57-436d-97b5-e8f52cd67fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaea6187-ea9d-4119-a2d4-1111acf054d7', 'volume_name': 'volume-aaea6187-ea9d-4119-a2d4-1111acf054d7', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cff13b1c-ed64-4674-abe3-bedff07affbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cff13b1c-ed64-4674-abe3-bedff07affbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6438d45-0beb-4f29-95b4-3d1c78004d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:47 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Volume aaea6187-ea9d-4119-a2d4-1111acf054d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaea6187-ea9d-4119-a2d4-1111acf054d7', 'volume_size': 1} Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-90600831-50a0-4067-a2be-d08dc5c110eb tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4 1G" returned: 0 in 0.718s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-90600831-50a0-4067-a2be-d08dc5c110eb tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d21b1fa2-4790-43f4-aa3e-c266617653ca -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:47 devstack sudo[87436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d21b1fa2-4790-43f4-aa3e-c266617653ca -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4 Feb 27 12:31:47 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:48 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-90600831-50a0-4067-a2be-d08dc5c110eb tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d21b1fa2-4790-43f4-aa3e-c266617653ca -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4" returned: 0 in 0.500s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:48 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-90600831-50a0-4067-a2be-d08dc5c110eb tempest-VolumesSnapshotListTestJSON-392029018 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4 is being set with open permissions: ugo+rw Feb 27 12:31:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-90600831-50a0-4067-a2be-d08dc5c110eb tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:48 devstack sudo[87441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4 Feb 27 12:31:48 devstack sudo[87441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:48 devstack sudo[87441]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-90600831-50a0-4067-a2be-d08dc5c110eb tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4" returned: 0 in 0.495s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-90600831-50a0-4067-a2be-d08dc5c110eb tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:48 devstack sudo[87444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.info Feb 27 12:31:48 devstack sudo[87444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:49 devstack sudo[87444]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-90600831-50a0-4067-a2be-d08dc5c110eb tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.info" returned: 0 in 0.466s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:49 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-90600831-50a0-4067-a2be-d08dc5c110eb tempest-VolumesSnapshotListTestJSON-392029018 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.info is being set with open permissions: ugo+rw Feb 27 12:31:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-90600831-50a0-4067-a2be-d08dc5c110eb tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:49 devstack sudo[87447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.info Feb 27 12:31:49 devstack sudo[87447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:49 devstack sudo[87447]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-90600831-50a0-4067-a2be-d08dc5c110eb tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.info" returned: 0 in 0.537s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-90600831-50a0-4067-a2be-d08dc5c110eb tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.543s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.050s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:49 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-514164171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaea6187-ea9d-4119-a2d4-1111acf054d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc300440c7c4b3db3dddb2c06990970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:48Z,use_quota=True,user_id='6b19d90c41bc429b988af5d679374036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:31:49 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Creating volume aaea6187-ea9d-4119-a2d4-1111acf054d7 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:31:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:49 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:50 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:50 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:31:50 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:31:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:50 devstack sudo[87475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7 1073741824 Feb 27 12:31:50 devstack sudo[87475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:50 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-90600831-50a0-4067-a2be-d08dc5c110eb tempest-VolumesSnapshotListTestJSON-392029018 None] Create snapshot completed successfully Feb 27 12:31:50 devstack sudo[87475]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7 1073741824" returned: 0 in 0.586s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:50 devstack sudo[87481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7 Feb 27 12:31:50 devstack sudo[87481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8e67119c-da7c-40f9-a0d6-06e2347287d3 tempest-VolumesSnapshotListTestJSON-392029018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:51 devstack sudo[87481]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7" returned: 0 in 0.483s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:51 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:31:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8e67119c-da7c-40f9-a0d6-06e2347287d3 tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.313s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6438d45-0beb-4f29-95b4-3d1c78004d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaea6187-ea9d-4119-a2d4-1111acf054d7', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc9c5a6e-beb0-42a0-bb91-ba2a61f0b10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:51 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Volume volume-aaea6187-ea9d-4119-a2d4-1111acf054d7 (aaea6187-ea9d-4119-a2d4-1111acf054d7): created successfully Feb 27 12:31:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc9c5a6e-beb0-42a0-bb91-ba2a61f0b10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Flow 'volume_create_manager' (26350e88-046d-4c92-9161-52ca5f96f782) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:51 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-836e0d5f-f8a9-475f-acef-ef89aa178d24 tempest-VolumesDeleteCascade-1708497653 None] Created volume successfully. Feb 27 12:31:51 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-8e67119c-da7c-40f9-a0d6-06e2347287d3 tempest-VolumesSnapshotListTestJSON-392029018 None] Creating offline snapshot 9ad048fa-6301-492f-a208-6c46c42287c8 of volume d21b1fa2-4790-43f4-aa3e-c266617653ca {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:31:51 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f68077-e8a2-4a01-b671-59ab50a1b232]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8e67119c-da7c-40f9-a0d6-06e2347287d3 tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:51 devstack sudo[87485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4 Feb 27 12:31:51 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:51 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8e67119c-da7c-40f9-a0d6-06e2347287d3 tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4" returned: 0 in 0.600s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:51 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-8e67119c-da7c-40f9-a0d6-06e2347287d3 tempest-VolumesSnapshotListTestJSON-392029018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d21b1fa2-4790-43f4-aa3e-c266617653ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:31:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8e67119c-da7c-40f9-a0d6-06e2347287d3 tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:51 devstack sudo[87491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8 1G Feb 27 12:31:51 devstack sudo[87491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-22afee36-a4cf-4062-9dc7-b525780719ee tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:52 devstack sudo[87491]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8e67119c-da7c-40f9-a0d6-06e2347287d3 tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8 1G" returned: 0 in 0.583s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8e67119c-da7c-40f9-a0d6-06e2347287d3 tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:52 devstack sudo[87496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8 Feb 27 12:31:52 devstack sudo[87496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:52 devstack sudo[87496]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8e67119c-da7c-40f9-a0d6-06e2347287d3 tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8" returned: 0 in 0.476s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:52 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-8e67119c-da7c-40f9-a0d6-06e2347287d3 tempest-VolumesSnapshotListTestJSON-392029018 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8 is being set with open permissions: ugo+rw Feb 27 12:31:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8e67119c-da7c-40f9-a0d6-06e2347287d3 tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:52 devstack sudo[87501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8 Feb 27 12:31:52 devstack sudo[87501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:53 devstack sudo[87501]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8e67119c-da7c-40f9-a0d6-06e2347287d3 tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8" returned: 0 in 0.459s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8e67119c-da7c-40f9-a0d6-06e2347287d3 tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.215s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-22afee36-a4cf-4062-9dc7-b525780719ee tempest-VolumesDeleteCascade-1708497653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.117s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:53 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-22afee36-a4cf-4062-9dc7-b525780719ee tempest-VolumesDeleteCascade-1708497653 None] Creating offline snapshot 379ae814-39ad-4a13-a2d9-6cc0d8b95a78 of volume aaea6187-ea9d-4119-a2d4-1111acf054d7 {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:31:53 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9904059c-3ea1-4b7f-bbae-9122f413a52e]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-22afee36-a4cf-4062-9dc7-b525780719ee tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:53 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-8e67119c-da7c-40f9-a0d6-06e2347287d3 tempest-VolumesSnapshotListTestJSON-392029018 None] Create snapshot completed successfully Feb 27 12:31:53 devstack sudo[87504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7 Feb 27 12:31:53 devstack sudo[87504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:53 devstack sudo[87504]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-22afee36-a4cf-4062-9dc7-b525780719ee tempest-VolumesDeleteCascade-1708497653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7" returned: 0 in 0.535s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-22afee36-a4cf-4062-9dc7-b525780719ee tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.379ae814-39ad-4a13-a2d9-6cc0d8b95a78 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:53 devstack sudo[87509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.379ae814-39ad-4a13-a2d9-6cc0d8b95a78 1G Feb 27 12:31:53 devstack sudo[87509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-5c3f7f4e-4847-44ea-9855-08b8b1c72b61 tempest-VolumesSnapshotListTestJSON-392029018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:54 devstack sudo[87509]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-22afee36-a4cf-4062-9dc7-b525780719ee tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.379ae814-39ad-4a13-a2d9-6cc0d8b95a78 1G" returned: 0 in 0.530s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-22afee36-a4cf-4062-9dc7-b525780719ee tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaea6187-ea9d-4119-a2d4-1111acf054d7 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.379ae814-39ad-4a13-a2d9-6cc0d8b95a78 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:54 devstack sudo[87514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaea6187-ea9d-4119-a2d4-1111acf054d7 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.379ae814-39ad-4a13-a2d9-6cc0d8b95a78 Feb 27 12:31:54 devstack sudo[87514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:54 devstack sudo[87514]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-22afee36-a4cf-4062-9dc7-b525780719ee tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaea6187-ea9d-4119-a2d4-1111acf054d7 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.379ae814-39ad-4a13-a2d9-6cc0d8b95a78" returned: 0 in 0.445s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:54 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-22afee36-a4cf-4062-9dc7-b525780719ee tempest-VolumesDeleteCascade-1708497653 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.379ae814-39ad-4a13-a2d9-6cc0d8b95a78 is being set with open permissions: ugo+rw Feb 27 12:31:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-22afee36-a4cf-4062-9dc7-b525780719ee tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.379ae814-39ad-4a13-a2d9-6cc0d8b95a78 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:54 devstack sudo[87519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.379ae814-39ad-4a13-a2d9-6cc0d8b95a78 Feb 27 12:31:54 devstack sudo[87519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:55 devstack sudo[87519]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-22afee36-a4cf-4062-9dc7-b525780719ee tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.379ae814-39ad-4a13-a2d9-6cc0d8b95a78" returned: 0 in 0.472s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-22afee36-a4cf-4062-9dc7-b525780719ee tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:55 devstack sudo[87522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.info Feb 27 12:31:55 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:55 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-22afee36-a4cf-4062-9dc7-b525780719ee tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.info" returned: 0 in 0.416s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:55 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-22afee36-a4cf-4062-9dc7-b525780719ee tempest-VolumesDeleteCascade-1708497653 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.info is being set with open permissions: ugo+rw Feb 27 12:31:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-22afee36-a4cf-4062-9dc7-b525780719ee tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:55 devstack sudo[87525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.info Feb 27 12:31:55 devstack sudo[87525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:56 devstack sudo[87525]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-22afee36-a4cf-4062-9dc7-b525780719ee tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.info" returned: 0 in 0.533s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-22afee36-a4cf-4062-9dc7-b525780719ee tempest-VolumesDeleteCascade-1708497653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.998s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-5c3f7f4e-4847-44ea-9855-08b8b1c72b61 tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.293s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:56 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-5c3f7f4e-4847-44ea-9855-08b8b1c72b61 tempest-VolumesSnapshotListTestJSON-392029018 None] Creating offline snapshot 08522a94-1367-49ce-9f7f-0032e64bebf9 of volume d21b1fa2-4790-43f4-aa3e-c266617653ca {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:31:56 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-22afee36-a4cf-4062-9dc7-b525780719ee tempest-VolumesDeleteCascade-1708497653 None] Create snapshot completed successfully Feb 27 12:31:56 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c0665e-79f3-4116-963d-ec117131e786]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5c3f7f4e-4847-44ea-9855-08b8b1c72b61 tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:56 devstack sudo[87549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8 Feb 27 12:31:56 devstack sudo[87549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:56 devstack sudo[87549]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5c3f7f4e-4847-44ea-9855-08b8b1c72b61 tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8" returned: 0 in 0.496s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:56 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-5c3f7f4e-4847-44ea-9855-08b8b1c72b61 tempest-VolumesSnapshotListTestJSON-392029018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d21b1fa2-4790-43f4-aa3e-c266617653ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:31:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5c3f7f4e-4847-44ea-9855-08b8b1c72b61 tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.08522a94-1367-49ce-9f7f-0032e64bebf9 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:56 devstack sudo[87556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.08522a94-1367-49ce-9f7f-0032e64bebf9 1G Feb 27 12:31:56 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:57 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5c3f7f4e-4847-44ea-9855-08b8b1c72b61 tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.08522a94-1367-49ce-9f7f-0032e64bebf9 1G" returned: 0 in 0.596s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5c3f7f4e-4847-44ea-9855-08b8b1c72b61 tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.08522a94-1367-49ce-9f7f-0032e64bebf9 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:57 devstack sudo[87561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.08522a94-1367-49ce-9f7f-0032e64bebf9 Feb 27 12:31:57 devstack sudo[87561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:57 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:31:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Flow 'volume_create_manager' (3fdf052a-cafd-407c-aab9-f35cf89540da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a72396e-9c2d-4663-b470-120c380ad877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a72396e-9c2d-4663-b470-120c380ad877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-77545156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b223f68f-76d6-45c8-884e-ec58b36b7882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc300440c7c4b3db3dddb2c06990970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=379ae814-39ad-4a13-a2d9-6cc0d8b95a78,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:58Z,use_quota=True,user_id='6b19d90c41bc429b988af5d679374036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e314c34-5d9a-4255-afde-604bff00c640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e314c34-5d9a-4255-afde-604bff00c640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c877fb-4547-42c2-b3d8-a491193d184d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c877fb-4547-42c2-b3d8-a491193d184d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b223f68f-76d6-45c8-884e-ec58b36b7882', 'volume_name': 'volume-b223f68f-76d6-45c8-884e-ec58b36b7882', 'volume_size': 1, 'snapshot_id': '379ae814-39ad-4a13-a2d9-6cc0d8b95a78'}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc20518-7eb3-4821-96ae-fd45d4980ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc20518-7eb3-4821-96ae-fd45d4980ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6477fa6-1cf9-4a17-a3b5-76738ad4cdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:57 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Volume b223f68f-76d6-45c8-884e-ec58b36b7882: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b223f68f-76d6-45c8-884e-ec58b36b7882', 'volume_size': 1, 'snapshot_id': '379ae814-39ad-4a13-a2d9-6cc0d8b95a78'} Feb 27 12:31:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:58 devstack sudo[87561]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5c3f7f4e-4847-44ea-9855-08b8b1c72b61 tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.08522a94-1367-49ce-9f7f-0032e64bebf9" returned: 0 in 0.550s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:58 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-5c3f7f4e-4847-44ea-9855-08b8b1c72b61 tempest-VolumesSnapshotListTestJSON-392029018 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.08522a94-1367-49ce-9f7f-0032e64bebf9 is being set with open permissions: ugo+rw Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5c3f7f4e-4847-44ea-9855-08b8b1c72b61 tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.08522a94-1367-49ce-9f7f-0032e64bebf9 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:58 devstack sudo[87567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.08522a94-1367-49ce-9f7f-0032e64bebf9 Feb 27 12:31:58 devstack sudo[87567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:58 devstack sudo[87567]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5c3f7f4e-4847-44ea-9855-08b8b1c72b61 tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.08522a94-1367-49ce-9f7f-0032e64bebf9" returned: 0 in 0.394s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-5c3f7f4e-4847-44ea-9855-08b8b1c72b61 tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.110s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.537s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "cinder-quobyte-379ae814-39ad-4a13-a2d9-6cc0d8b95a78-b223f68f-76d6-45c8-884e-ec58b36b7882" by "_create_volume_from_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:58 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-5c3f7f4e-4847-44ea-9855-08b8b1c72b61 tempest-VolumesSnapshotListTestJSON-392029018 None] Create snapshot completed successfully Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-quobyte-379ae814-39ad-4a13-a2d9-6cc0d8b95a78-b223f68f-76d6-45c8-884e-ec58b36b7882" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Creating volume b223f68f-76d6-45c8-884e-ec58b36b7882 from snapshot 379ae814-39ad-4a13-a2d9-6cc0d8b95a78 {{(pid=83077) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "cinder-quobyte-b223f68f-76d6-45c8-884e-ec58b36b7882" by "_copy_volume_from_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-quobyte-b223f68f-76d6-45c8-884e-ec58b36b7882" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] snapshot: 379ae814-39ad-4a13-a2d9-6cc0d8b95a78, volume: b223f68f-76d6-45c8-884e-ec58b36b7882, {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG oslo_service.periodic_task [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83077) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b35168-cacc-4090-96a9-6c16552cfc46]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.379ae814-39ad-4a13-a2d9-6cc0d8b95a78 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:58 devstack sudo[87570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:31:58 devstack sudo[87570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:58 devstack sudo[87571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.379ae814-39ad-4a13-a2d9-6cc0d8b95a78 Feb 27 12:31:58 devstack sudo[87571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:58 devstack cinder-volume[83077]: INFO cinder.volume.manager [req-044309d6-50ad-43a9-9242-bb7202fbaeb0 req-65c4f3a0-970c-4131-8198-54bfdf4f7013 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Terminate volume connection completed successfully. Feb 27 12:31:58 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-044309d6-50ad-43a9-9242-bb7202fbaeb0 req-65c4f3a0-970c-4131-8198-54bfdf4f7013 tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Deleting attachment 77423115-48ae-43f2-8bc6-d5c2a2506d32. {{(pid=83077) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 27 12:31:59 devstack sudo[87570]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.526s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:59 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:31:59 devstack sudo[87571]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.379ae814-39ad-4a13-a2d9-6cc0d8b95a78" returned: 0 in 0.606s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:59 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aaea6187-ea9d-4119-a2d4-1111acf054d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:31:59 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7 {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 12:31:59 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Creating direct copy from snapshot {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 12:31:59 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9ca523-e2ac-43ce-b028-9f1d3b5e47be]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:59 devstack sudo[87578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7 Feb 27 12:31:59 devstack sudo[87578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:59 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-044309d6-50ad-43a9-9242-bb7202fbaeb0 req-d4a09cae-ddb9-4f95-82d7-0e7323f4346d tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Acquiring lock "cinder-7ce79331-c41f-427d-bab9-043b0ea46353-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:59 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-044309d6-50ad-43a9-9242-bb7202fbaeb0 req-d4a09cae-ddb9-4f95-82d7-0e7323f4346d tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Lock "cinder-7ce79331-c41f-427d-bab9-043b0ea46353-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:59 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-044309d6-50ad-43a9-9242-bb7202fbaeb0 req-d4a09cae-ddb9-4f95-82d7-0e7323f4346d tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Acquiring lock "cinder-quobyte-7ce79331-c41f-427d-bab9-043b0ea46353" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:59 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-044309d6-50ad-43a9-9242-bb7202fbaeb0 req-d4a09cae-ddb9-4f95-82d7-0e7323f4346d tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Lock "cinder-quobyte-7ce79331-c41f-427d-bab9-043b0ea46353" acquired by "delete_volume" :: waited 0.013s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:59 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[530f37ed-a5bd-441c-bb62-57aef62caac6]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-044309d6-50ad-43a9-9242-bb7202fbaeb0 req-d4a09cae-ddb9-4f95-82d7-0e7323f4346d tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7ce79331-c41f-427d-bab9-043b0ea46353 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:59 devstack sudo[87580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7ce79331-c41f-427d-bab9-043b0ea46353 Feb 27 12:31:59 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:59 devstack sudo[87578]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7" returned: 0 in 0.662s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:59 devstack cinder-volume[83077]: DEBUG cinder.utils [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Path /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b223f68f-76d6-45c8-884e-ec58b36b7882 not found in is_blk_device check {{(pid=83077) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 12:31:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b223f68f-76d6-45c8-884e-ec58b36b7882 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:59 devstack sudo[87585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b223f68f-76d6-45c8-884e-ec58b36b7882 Feb 27 12:31:59 devstack sudo[87585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:59 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-54fb95a3-8e77-4e80-bfd0-402123f5a8b0 tempest-VolumesSnapshotListTestJSON-392029018 None] Acquiring lock "cinder-08522a94-1367-49ce-9f7f-0032e64bebf9-delete_snapshot" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:59 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-54fb95a3-8e77-4e80-bfd0-402123f5a8b0 tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "cinder-08522a94-1367-49ce-9f7f-0032e64bebf9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:59 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-54fb95a3-8e77-4e80-bfd0-402123f5a8b0 tempest-VolumesSnapshotListTestJSON-392029018 None] Acquiring lock "cinder-quobyte-d21b1fa2-4790-43f4-aa3e-c266617653ca" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:59 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-54fb95a3-8e77-4e80-bfd0-402123f5a8b0 tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "cinder-quobyte-d21b1fa2-4790-43f4-aa3e-c266617653ca" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:59 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-54fb95a3-8e77-4e80-bfd0-402123f5a8b0 tempest-VolumesSnapshotListTestJSON-392029018 None] Acquiring lock "cinder-quobyte-08522a94-1367-49ce-9f7f-0032e64bebf9" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:59 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-54fb95a3-8e77-4e80-bfd0-402123f5a8b0 tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "cinder-quobyte-08522a94-1367-49ce-9f7f-0032e64bebf9" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:59 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-54fb95a3-8e77-4e80-bfd0-402123f5a8b0 tempest-VolumesSnapshotListTestJSON-392029018 None] Deleting offline snapshot 08522a94-1367-49ce-9f7f-0032e64bebf9 of volume d21b1fa2-4790-43f4-aa3e-c266617653ca {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:31:59 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-54fb95a3-8e77-4e80-bfd0-402123f5a8b0 tempest-VolumesSnapshotListTestJSON-392029018 None] snapshot_file for this snap is: volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.08522a94-1367-49ce-9f7f-0032e64bebf9 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:31:59 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f5fc93-ab2b-40c7-a8f4-a99e9f867a89]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-54fb95a3-8e77-4e80-bfd0-402123f5a8b0 tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.08522a94-1367-49ce-9f7f-0032e64bebf9 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:00 devstack sudo[87587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.08522a94-1367-49ce-9f7f-0032e64bebf9 Feb 27 12:32:00 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:00 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-044309d6-50ad-43a9-9242-bb7202fbaeb0 req-d4a09cae-ddb9-4f95-82d7-0e7323f4346d tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7ce79331-c41f-427d-bab9-043b0ea46353" returned: 0 in 0.742s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-044309d6-50ad-43a9-9242-bb7202fbaeb0 req-d4a09cae-ddb9-4f95-82d7-0e7323f4346d tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7ce79331-c41f-427d-bab9-043b0ea46353 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:00 devstack sudo[87592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7ce79331-c41f-427d-bab9-043b0ea46353 Feb 27 12:32:00 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:01 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-54fb95a3-8e77-4e80-bfd0-402123f5a8b0 tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.08522a94-1367-49ce-9f7f-0032e64bebf9" returned: 0 in 1.106s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:01 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-54fb95a3-8e77-4e80-bfd0-402123f5a8b0 tempest-VolumesSnapshotListTestJSON-392029018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d21b1fa2-4790-43f4-aa3e-c266617653ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:32:01 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f2101e-9b45-4607-b7bc-50680d5dbfbc]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-54fb95a3-8e77-4e80-bfd0-402123f5a8b0 tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:01 devstack sudo[87608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8 Feb 27 12:32:01 devstack sudo[87608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:01 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-044309d6-50ad-43a9-9242-bb7202fbaeb0 req-d4a09cae-ddb9-4f95-82d7-0e7323f4346d tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7ce79331-c41f-427d-bab9-043b0ea46353" returned: 0 in 1.370s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:01 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-044309d6-50ad-43a9-9242-bb7202fbaeb0 req-d4a09cae-ddb9-4f95-82d7-0e7323f4346d tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Lock "cinder-quobyte-7ce79331-c41f-427d-bab9-043b0ea46353" released by "delete_volume" :: held 2.161s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:01 devstack cinder-volume[83077]: DEBUG cinder.quota [req-044309d6-50ad-43a9-9242-bb7202fbaeb0 req-d4a09cae-ddb9-4f95-82d7-0e7323f4346d tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Created reservations ['a866e4da-4e82-4d48-976a-9842dea34271', '1cbd9483-7883-4e30-b7fe-9f2a8fd9de84', '344333b9-efdc-41dc-983b-bc0c32196a65', 'cfcfa8dd-db2b-4fed-9da1-58575058ee00'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-044309d6-50ad-43a9-9242-bb7202fbaeb0 req-d4a09cae-ddb9-4f95-82d7-0e7323f4346d tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-044309d6-50ad-43a9-9242-bb7202fbaeb0 req-d4a09cae-ddb9-4f95-82d7-0e7323f4346d tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:01 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-044309d6-50ad-43a9-9242-bb7202fbaeb0 req-d4a09cae-ddb9-4f95-82d7-0e7323f4346d tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:01 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-044309d6-50ad-43a9-9242-bb7202fbaeb0 req-d4a09cae-ddb9-4f95-82d7-0e7323f4346d tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-044309d6-50ad-43a9-9242-bb7202fbaeb0 req-d4a09cae-ddb9-4f95-82d7-0e7323f4346d tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-044309d6-50ad-43a9-9242-bb7202fbaeb0 req-d4a09cae-ddb9-4f95-82d7-0e7323f4346d tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:02 devstack sudo[87611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:32:02 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:02 devstack sudo[87585]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b223f68f-76d6-45c8-884e-ec58b36b7882" returned: 0 in 2.582s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:02 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11c86c5-4009-453a-9a4a-5dcc00b30a2e]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:02 devstack sudo[87615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7 Feb 27 12:32:02 devstack sudo[87615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:02 devstack sudo[87608]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-54fb95a3-8e77-4e80-bfd0-402123f5a8b0 tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8" returned: 0 in 1.505s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:02 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-54fb95a3-8e77-4e80-bfd0-402123f5a8b0 tempest-VolumesSnapshotListTestJSON-392029018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d21b1fa2-4790-43f4-aa3e-c266617653ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:32:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-54fb95a3-8e77-4e80-bfd0-402123f5a8b0 tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.08522a94-1367-49ce-9f7f-0032e64bebf9 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:02 devstack sudo[87620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.08522a94-1367-49ce-9f7f-0032e64bebf9 Feb 27 12:32:02 devstack sudo[87620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:02 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-044309d6-50ad-43a9-9242-bb7202fbaeb0 req-d4a09cae-ddb9-4f95-82d7-0e7323f4346d tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.808s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:02 devstack cinder-volume[83077]: DEBUG cinder.manager [req-044309d6-50ad-43a9-9242-bb7202fbaeb0 req-d4a09cae-ddb9-4f95-82d7-0e7323f4346d tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:02 devstack cinder-volume[83077]: INFO cinder.volume.manager [req-044309d6-50ad-43a9-9242-bb7202fbaeb0 req-d4a09cae-ddb9-4f95-82d7-0e7323f4346d tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Deleted volume successfully. Feb 27 12:32:02 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-044309d6-50ad-43a9-9242-bb7202fbaeb0 req-d4a09cae-ddb9-4f95-82d7-0e7323f4346d tempest-ServerBootFromVolumeStableRescueTest-1731263785 None] Lock "cinder-7ce79331-c41f-427d-bab9-043b0ea46353-delete_volume" released by "delete_volume" :: held 3.395s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:03 devstack sudo[87615]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7" returned: 0 in 0.741s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:03 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Image conversion details: src /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7, size 1024.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b223f68f-76d6-45c8-884e-ec58b36b7882 {{(pid=83077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:32:03 devstack cinder-volume[83077]: INFO cinder.image.image_utils [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Converted 1024.00 MB image at 396.36 MB/s Feb 27 12:32:03 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b223f68f-76d6-45c8-884e-ec58b36b7882 is being set with open permissions: ugo+rw Feb 27 12:32:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b223f68f-76d6-45c8-884e-ec58b36b7882 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:03 devstack sudo[87629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b223f68f-76d6-45c8-884e-ec58b36b7882 Feb 27 12:32:03 devstack sudo[87629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:03 devstack sudo[87620]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-54fb95a3-8e77-4e80-bfd0-402123f5a8b0 tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.08522a94-1367-49ce-9f7f-0032e64bebf9" returned: 0 in 0.665s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-54fb95a3-8e77-4e80-bfd0-402123f5a8b0 tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.08522a94-1367-49ce-9f7f-0032e64bebf9 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:03 devstack sudo[87631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.08522a94-1367-49ce-9f7f-0032e64bebf9 Feb 27 12:32:03 devstack sudo[87631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:03 devstack sudo[87629]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b223f68f-76d6-45c8-884e-ec58b36b7882" returned: 0 in 0.484s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-quobyte-b223f68f-76d6-45c8-884e-ec58b36b7882" released by "_copy_volume_from_snapshot" :: held 5.156s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-quobyte-379ae814-39ad-4a13-a2d9-6cc0d8b95a78-b223f68f-76d6-45c8-884e-ec58b36b7882" released by "_create_volume_from_snapshot" :: held 5.179s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.205s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:03 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6477fa6-1cf9-4a17-a3b5-76738ad4cdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b223f68f-76d6-45c8-884e-ec58b36b7882', 'volume_size': 1, 'snapshot_id': '379ae814-39ad-4a13-a2d9-6cc0d8b95a78'}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:03 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34277746-b6a7-46ac-b601-a94f0dcb9e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:03 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Volume volume-b223f68f-76d6-45c8-884e-ec58b36b7882 (b223f68f-76d6-45c8-884e-ec58b36b7882): created successfully Feb 27 12:32:03 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34277746-b6a7-46ac-b601-a94f0dcb9e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:03 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Flow 'volume_create_manager' (3fdf052a-cafd-407c-aab9-f35cf89540da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:03 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-8619d165-d233-4bb4-9baf-9f43e5a59a92 tempest-VolumesDeleteCascade-1708497653 None] Created volume successfully. Feb 27 12:32:03 devstack sudo[87631]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-54fb95a3-8e77-4e80-bfd0-402123f5a8b0 tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.08522a94-1367-49ce-9f7f-0032e64bebf9" returned: 0 in 0.480s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-54fb95a3-8e77-4e80-bfd0-402123f5a8b0 tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "cinder-quobyte-08522a94-1367-49ce-9f7f-0032e64bebf9" released by "_delete_snapshot" :: held 3.848s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-54fb95a3-8e77-4e80-bfd0-402123f5a8b0 tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "cinder-quobyte-d21b1fa2-4790-43f4-aa3e-c266617653ca" released by "delete_snapshot" :: held 3.866s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:03 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-54fb95a3-8e77-4e80-bfd0-402123f5a8b0 tempest-VolumesSnapshotListTestJSON-392029018 None] Created reservations ['0b05e132-1ac6-4aca-83e1-29b2e4012b08', '9a880104-5c76-4afa-9afb-ec1def7b83bc', '939ed8fa-695c-4c3d-b1eb-42fb9ab62264', '2e9d9c57-d944-4d58-9c9f-4165a0262ea5'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:03 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-54fb95a3-8e77-4e80-bfd0-402123f5a8b0 tempest-VolumesSnapshotListTestJSON-392029018 None] Delete snapshot completed successfully. Feb 27 12:32:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-54fb95a3-8e77-4e80-bfd0-402123f5a8b0 tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "cinder-08522a94-1367-49ce-9f7f-0032e64bebf9-delete_snapshot" released by "delete_snapshot" :: held 3.950s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-519c9d5f-9a27-495c-ae64-ed1e85f95a30 tempest-VolumesSnapshotListTestJSON-392029018 None] Acquiring lock "cinder-9ad048fa-6301-492f-a208-6c46c42287c8-delete_snapshot" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-519c9d5f-9a27-495c-ae64-ed1e85f95a30 tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "cinder-9ad048fa-6301-492f-a208-6c46c42287c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-519c9d5f-9a27-495c-ae64-ed1e85f95a30 tempest-VolumesSnapshotListTestJSON-392029018 None] Acquiring lock "cinder-quobyte-d21b1fa2-4790-43f4-aa3e-c266617653ca" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-519c9d5f-9a27-495c-ae64-ed1e85f95a30 tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "cinder-quobyte-d21b1fa2-4790-43f4-aa3e-c266617653ca" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-519c9d5f-9a27-495c-ae64-ed1e85f95a30 tempest-VolumesSnapshotListTestJSON-392029018 None] Acquiring lock "cinder-quobyte-9ad048fa-6301-492f-a208-6c46c42287c8" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-519c9d5f-9a27-495c-ae64-ed1e85f95a30 tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "cinder-quobyte-9ad048fa-6301-492f-a208-6c46c42287c8" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-519c9d5f-9a27-495c-ae64-ed1e85f95a30 tempest-VolumesSnapshotListTestJSON-392029018 None] Deleting offline snapshot 9ad048fa-6301-492f-a208-6c46c42287c8 of volume d21b1fa2-4790-43f4-aa3e-c266617653ca {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:32:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-519c9d5f-9a27-495c-ae64-ed1e85f95a30 tempest-VolumesSnapshotListTestJSON-392029018 None] snapshot_file for this snap is: volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:32:04 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[344cd504-60af-471d-b25e-7e5837b345e6]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-519c9d5f-9a27-495c-ae64-ed1e85f95a30 tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:04 devstack sudo[87660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8 Feb 27 12:32:04 devstack sudo[87660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "cinder-aaea6187-ea9d-4119-a2d4-1111acf054d7-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-aaea6187-ea9d-4119-a2d4-1111acf054d7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Performing cascade delete. {{(pid=83077) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Feb 27 12:32:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "cinder-379ae814-39ad-4a13-a2d9-6cc0d8b95a78-delete_snapshot" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-379ae814-39ad-4a13-a2d9-6cc0d8b95a78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "cinder-quobyte-aaea6187-ea9d-4119-a2d4-1111acf054d7" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-quobyte-aaea6187-ea9d-4119-a2d4-1111acf054d7" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "cinder-quobyte-379ae814-39ad-4a13-a2d9-6cc0d8b95a78" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-quobyte-379ae814-39ad-4a13-a2d9-6cc0d8b95a78" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Deleting offline snapshot 379ae814-39ad-4a13-a2d9-6cc0d8b95a78 of volume aaea6187-ea9d-4119-a2d4-1111acf054d7 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:32:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] snapshot_file for this snap is: volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.379ae814-39ad-4a13-a2d9-6cc0d8b95a78 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:32:04 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43e15d9-6fa4-4a51-937f-c74ce5ab12ef]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.379ae814-39ad-4a13-a2d9-6cc0d8b95a78 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:04 devstack sudo[87663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.379ae814-39ad-4a13-a2d9-6cc0d8b95a78 Feb 27 12:32:04 devstack sudo[87663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:05 devstack sudo[87660]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-519c9d5f-9a27-495c-ae64-ed1e85f95a30 tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8" returned: 0 in 0.591s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:05 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-519c9d5f-9a27-495c-ae64-ed1e85f95a30 tempest-VolumesSnapshotListTestJSON-392029018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d21b1fa2-4790-43f4-aa3e-c266617653ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:32:05 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c527a6-b722-42cf-98bd-32a60dc84f3f]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-519c9d5f-9a27-495c-ae64-ed1e85f95a30 tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:05 devstack sudo[87668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4 Feb 27 12:32:05 devstack sudo[87668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:05 devstack sudo[87663]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.379ae814-39ad-4a13-a2d9-6cc0d8b95a78" returned: 0 in 0.587s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:05 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aaea6187-ea9d-4119-a2d4-1111acf054d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:32:05 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[a382fe46-0807-40f1-a2d2-2adeb29435be]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:05 devstack sudo[87673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7 Feb 27 12:32:05 devstack sudo[87673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:05 devstack sudo[87668]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-519c9d5f-9a27-495c-ae64-ed1e85f95a30 tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4" returned: 0 in 0.577s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:05 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-519c9d5f-9a27-495c-ae64-ed1e85f95a30 tempest-VolumesSnapshotListTestJSON-392029018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d21b1fa2-4790-43f4-aa3e-c266617653ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:32:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-519c9d5f-9a27-495c-ae64-ed1e85f95a30 tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:05 devstack sudo[87678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8 Feb 27 12:32:05 devstack sudo[87678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:05 devstack sudo[87673]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7" returned: 0 in 0.601s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.379ae814-39ad-4a13-a2d9-6cc0d8b95a78 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:05 devstack sudo[87684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.379ae814-39ad-4a13-a2d9-6cc0d8b95a78 Feb 27 12:32:05 devstack sudo[87684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:06 devstack sudo[87678]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-519c9d5f-9a27-495c-ae64-ed1e85f95a30 tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8" returned: 0 in 0.593s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-519c9d5f-9a27-495c-ae64-ed1e85f95a30 tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:06 devstack sudo[87689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8 Feb 27 12:32:06 devstack sudo[87689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:06 devstack sudo[87684]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.379ae814-39ad-4a13-a2d9-6cc0d8b95a78" returned: 0 in 0.518s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.379ae814-39ad-4a13-a2d9-6cc0d8b95a78 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:06 devstack sudo[87694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.379ae814-39ad-4a13-a2d9-6cc0d8b95a78 Feb 27 12:32:06 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:06 devstack sudo[87689]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-519c9d5f-9a27-495c-ae64-ed1e85f95a30 tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.9ad048fa-6301-492f-a208-6c46c42287c8" returned: 0 in 0.501s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:06 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-519c9d5f-9a27-495c-ae64-ed1e85f95a30 tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "cinder-quobyte-9ad048fa-6301-492f-a208-6c46c42287c8" released by "_delete_snapshot" :: held 2.333s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:06 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-519c9d5f-9a27-495c-ae64-ed1e85f95a30 tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "cinder-quobyte-d21b1fa2-4790-43f4-aa3e-c266617653ca" released by "delete_snapshot" :: held 2.351s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:06 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-519c9d5f-9a27-495c-ae64-ed1e85f95a30 tempest-VolumesSnapshotListTestJSON-392029018 None] Created reservations ['5f7ea1d8-1670-4792-a12d-3036391b9968', '1905a4ff-20d6-4f72-95a1-c69034ad4e69', 'b170699b-8df3-4170-90b5-f0af579dde78', 'ac1967f1-5eba-44d2-b785-dc81576c2efc'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:06 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-519c9d5f-9a27-495c-ae64-ed1e85f95a30 tempest-VolumesSnapshotListTestJSON-392029018 None] Delete snapshot completed successfully. Feb 27 12:32:06 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-519c9d5f-9a27-495c-ae64-ed1e85f95a30 tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "cinder-9ad048fa-6301-492f-a208-6c46c42287c8-delete_snapshot" released by "delete_snapshot" :: held 2.473s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:07 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7.379ae814-39ad-4a13-a2d9-6cc0d8b95a78" returned: 0 in 0.523s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-quobyte-379ae814-39ad-4a13-a2d9-6cc0d8b95a78" released by "_delete_snapshot" :: held 2.287s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-quobyte-aaea6187-ea9d-4119-a2d4-1111acf054d7" released by "delete_snapshot" :: held 2.300s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:07 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Created reservations ['4a33976d-aa1a-4616-bfac-3a5bb276bd9a', 'c05821ff-087a-46c5-a4e8-39646ca39584', '81894d98-53ce-4465-98b2-ba0fa3a14ec8', 'b3343f8b-144c-4968-b393-0d32370f209e'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:07 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Delete snapshot completed successfully. Feb 27 12:32:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-379ae814-39ad-4a13-a2d9-6cc0d8b95a78-delete_snapshot" released by "delete_snapshot" :: held 2.394s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Snapshots deleted, issuing volume delete {{(pid=83077) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Feb 27 12:32:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "cinder-quobyte-aaea6187-ea9d-4119-a2d4-1111acf054d7" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-quobyte-aaea6187-ea9d-4119-a2d4-1111acf054d7" acquired by "delete_volume" :: waited 0.006s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:07 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa56e517-9a31-4a7e-b270-9d6c005959d1]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:07 devstack sudo[87698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7 Feb 27 12:32:07 devstack sudo[87698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7da06e40-dd54-4db2-a0d2-89c8ec520db0 tempest-VolumesSnapshotListTestJSON-392029018 None] Acquiring lock "cinder-88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4-delete_snapshot" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7da06e40-dd54-4db2-a0d2-89c8ec520db0 tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "cinder-88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7da06e40-dd54-4db2-a0d2-89c8ec520db0 tempest-VolumesSnapshotListTestJSON-392029018 None] Acquiring lock "cinder-quobyte-d21b1fa2-4790-43f4-aa3e-c266617653ca" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7da06e40-dd54-4db2-a0d2-89c8ec520db0 tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "cinder-quobyte-d21b1fa2-4790-43f4-aa3e-c266617653ca" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7da06e40-dd54-4db2-a0d2-89c8ec520db0 tempest-VolumesSnapshotListTestJSON-392029018 None] Acquiring lock "cinder-quobyte-88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7da06e40-dd54-4db2-a0d2-89c8ec520db0 tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "cinder-quobyte-88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:07 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-7da06e40-dd54-4db2-a0d2-89c8ec520db0 tempest-VolumesSnapshotListTestJSON-392029018 None] Deleting offline snapshot 88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4 of volume d21b1fa2-4790-43f4-aa3e-c266617653ca {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:32:07 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-7da06e40-dd54-4db2-a0d2-89c8ec520db0 tempest-VolumesSnapshotListTestJSON-392029018 None] snapshot_file for this snap is: volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:32:07 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e774ee3b-d350-49ac-a1b6-54fbc9aee51c]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7da06e40-dd54-4db2-a0d2-89c8ec520db0 tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:07 devstack sudo[87698]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7" returned: 0 in 0.598s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:07 devstack sudo[87704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7 Feb 27 12:32:07 devstack sudo[87704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:07 devstack sudo[87703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4 Feb 27 12:32:07 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:08 devstack sudo[87704]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-aaea6187-ea9d-4119-a2d4-1111acf054d7" returned: 0 in 0.491s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:08 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-quobyte-aaea6187-ea9d-4119-a2d4-1111acf054d7" released by "delete_volume" :: held 1.130s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:08 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Created reservations ['0f3047c5-0119-4800-91bb-6a39cd7fc3b0', '77d745ae-57e7-44bf-b158-c77dad7ccc7c', 'f5f85bf1-fa49-4ce3-85b8-76346466df73', 'd196bae3-c9d4-4db3-8df5-26e5c1370870'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:08 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:08 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:08 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7da06e40-dd54-4db2-a0d2-89c8ec520db0 tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4" returned: 0 in 0.662s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:08 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-7da06e40-dd54-4db2-a0d2-89c8ec520db0 tempest-VolumesSnapshotListTestJSON-392029018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d21b1fa2-4790-43f4-aa3e-c266617653ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:32:08 devstack sudo[87711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:32:08 devstack sudo[87711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:08 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[b136a1a0-dee5-4c12-828b-869f6898fa1d]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7da06e40-dd54-4db2-a0d2-89c8ec520db0 tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:08 devstack sudo[87713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca Feb 27 12:32:08 devstack sudo[87713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:08 devstack sudo[87711]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.469s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:08 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:08 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Deleted volume successfully. Feb 27 12:32:08 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6f9bcc39-a274-413d-bcae-de61a0839e5a tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-aaea6187-ea9d-4119-a2d4-1111acf054d7-delete_volume" released by "delete_volume" :: held 4.170s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:08 devstack sudo[87713]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7da06e40-dd54-4db2-a0d2-89c8ec520db0 tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca" returned: 0 in 0.518s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7da06e40-dd54-4db2-a0d2-89c8ec520db0 tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:08 devstack sudo[87719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4 Feb 27 12:32:08 devstack sudo[87719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:09 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-048cc5ea-266b-49be-ad17-37285424b52f tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "cinder-b223f68f-76d6-45c8-884e-ec58b36b7882-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:09 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-048cc5ea-266b-49be-ad17-37285424b52f tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-b223f68f-76d6-45c8-884e-ec58b36b7882-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:09 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-048cc5ea-266b-49be-ad17-37285424b52f tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "cinder-quobyte-b223f68f-76d6-45c8-884e-ec58b36b7882" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:09 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-048cc5ea-266b-49be-ad17-37285424b52f tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-quobyte-b223f68f-76d6-45c8-884e-ec58b36b7882" acquired by "delete_volume" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:09 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fa9edc-5a5a-4854-a290-21d9e7379ccb]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-048cc5ea-266b-49be-ad17-37285424b52f tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b223f68f-76d6-45c8-884e-ec58b36b7882 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:09 devstack sudo[87721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b223f68f-76d6-45c8-884e-ec58b36b7882 Feb 27 12:32:09 devstack sudo[87721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:09 devstack sudo[87719]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7da06e40-dd54-4db2-a0d2-89c8ec520db0 tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4" returned: 0 in 0.601s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7da06e40-dd54-4db2-a0d2-89c8ec520db0 tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:09 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4 Feb 27 12:32:09 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:09 devstack sudo[87721]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-048cc5ea-266b-49be-ad17-37285424b52f tempest-VolumesDeleteCascade-1708497653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b223f68f-76d6-45c8-884e-ec58b36b7882" returned: 0 in 0.708s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-048cc5ea-266b-49be-ad17-37285424b52f tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b223f68f-76d6-45c8-884e-ec58b36b7882 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:10 devstack sudo[87731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b223f68f-76d6-45c8-884e-ec58b36b7882 Feb 27 12:32:10 devstack sudo[87731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:10 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7da06e40-dd54-4db2-a0d2-89c8ec520db0 tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca.88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4" returned: 0 in 0.722s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7da06e40-dd54-4db2-a0d2-89c8ec520db0 tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "cinder-quobyte-88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4" released by "_delete_snapshot" :: held 2.580s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7da06e40-dd54-4db2-a0d2-89c8ec520db0 tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "cinder-quobyte-d21b1fa2-4790-43f4-aa3e-c266617653ca" released by "delete_snapshot" :: held 2.592s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:10 devstack cinder-volume[83077]: DEBUG dbcounter [-] [83077] Writing DB stats cinder:INSERT=53,cinder:UPDATE=194,cinder:SELECT=174,cinder:DELETE=17 {{(pid=83077) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:32:10 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-7da06e40-dd54-4db2-a0d2-89c8ec520db0 tempest-VolumesSnapshotListTestJSON-392029018 None] Created reservations ['d9ba445a-9eab-4a66-8a3d-827261960d4f', '04c54100-9a52-4426-a77d-09aa902c11aa', '38ce77ba-df96-4e35-b53e-1f79fbf317b4', 'bb45a125-fd93-4771-a6f8-3ff5a68164c4'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:10 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-7da06e40-dd54-4db2-a0d2-89c8ec520db0 tempest-VolumesSnapshotListTestJSON-392029018 None] Delete snapshot completed successfully. Feb 27 12:32:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7da06e40-dd54-4db2-a0d2-89c8ec520db0 tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "cinder-88cee0fe-db2e-4af0-b5b5-6a9ad7426ce4-delete_snapshot" released by "delete_snapshot" :: held 2.719s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:10 devstack sudo[87731]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-048cc5ea-266b-49be-ad17-37285424b52f tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b223f68f-76d6-45c8-884e-ec58b36b7882" returned: 0 in 0.524s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-048cc5ea-266b-49be-ad17-37285424b52f tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-quobyte-b223f68f-76d6-45c8-884e-ec58b36b7882" released by "delete_volume" :: held 1.264s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:10 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-048cc5ea-266b-49be-ad17-37285424b52f tempest-VolumesDeleteCascade-1708497653 None] Created reservations ['b3f5939b-71ca-4e25-ac3e-c40361972c40', '74d70c3a-ddd4-4b81-a9cd-b969cf39a2af', '7064038c-5d7a-4254-8ed4-23ffd275b0d2', 'a6c7187b-1aa4-4446-8f11-541eab5220dc'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-048cc5ea-266b-49be-ad17-37285424b52f tempest-VolumesDeleteCascade-1708497653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-048cc5ea-266b-49be-ad17-37285424b52f tempest-VolumesDeleteCascade-1708497653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:10 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-048cc5ea-266b-49be-ad17-37285424b52f tempest-VolumesDeleteCascade-1708497653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:10 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-048cc5ea-266b-49be-ad17-37285424b52f tempest-VolumesDeleteCascade-1708497653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-048cc5ea-266b-49be-ad17-37285424b52f tempest-VolumesDeleteCascade-1708497653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-048cc5ea-266b-49be-ad17-37285424b52f tempest-VolumesDeleteCascade-1708497653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:10 devstack sudo[87735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:32:10 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d5b94c46-0262-4761-9b4a-16908b75f0ae tempest-VolumesSnapshotListTestJSON-392029018 None] Acquiring lock "cinder-d21b1fa2-4790-43f4-aa3e-c266617653ca-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d5b94c46-0262-4761-9b4a-16908b75f0ae tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "cinder-d21b1fa2-4790-43f4-aa3e-c266617653ca-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d5b94c46-0262-4761-9b4a-16908b75f0ae tempest-VolumesSnapshotListTestJSON-392029018 None] Acquiring lock "cinder-quobyte-d21b1fa2-4790-43f4-aa3e-c266617653ca" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d5b94c46-0262-4761-9b4a-16908b75f0ae tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "cinder-quobyte-d21b1fa2-4790-43f4-aa3e-c266617653ca" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:10 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e984ee-aa70-4590-9615-ad22e8aaaf8b]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d5b94c46-0262-4761-9b4a-16908b75f0ae tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:11 devstack sudo[87742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca Feb 27 12:32:11 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:11 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-048cc5ea-266b-49be-ad17-37285424b52f tempest-VolumesDeleteCascade-1708497653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.542s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:11 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-048cc5ea-266b-49be-ad17-37285424b52f tempest-VolumesDeleteCascade-1708497653 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:11 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-048cc5ea-266b-49be-ad17-37285424b52f tempest-VolumesDeleteCascade-1708497653 None] Deleted volume successfully. Feb 27 12:32:11 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-048cc5ea-266b-49be-ad17-37285424b52f tempest-VolumesDeleteCascade-1708497653 None] Lock "cinder-b223f68f-76d6-45c8-884e-ec58b36b7882-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:11 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d5b94c46-0262-4761-9b4a-16908b75f0ae tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca" returned: 0 in 0.528s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d5b94c46-0262-4761-9b4a-16908b75f0ae tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:11 devstack sudo[87748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca Feb 27 12:32:11 devstack sudo[87748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:12 devstack sudo[87748]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d5b94c46-0262-4761-9b4a-16908b75f0ae tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d21b1fa2-4790-43f4-aa3e-c266617653ca" returned: 0 in 0.725s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:12 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d5b94c46-0262-4761-9b4a-16908b75f0ae tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "cinder-quobyte-d21b1fa2-4790-43f4-aa3e-c266617653ca" released by "delete_volume" :: held 1.290s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:12 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-d5b94c46-0262-4761-9b4a-16908b75f0ae tempest-VolumesSnapshotListTestJSON-392029018 None] Created reservations ['88881e6b-5e15-4ebc-9c8a-f51ceff9787a', '50ef02cc-e6ae-4fa5-87c3-114ea9263997', 'beef0b58-ac4f-43b4-8a1b-0ff697265f90', 'b21c3185-5ecd-4812-92a6-a7085d9fda74'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d5b94c46-0262-4761-9b4a-16908b75f0ae tempest-VolumesSnapshotListTestJSON-392029018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d5b94c46-0262-4761-9b4a-16908b75f0ae tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:12 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d5b94c46-0262-4761-9b4a-16908b75f0ae tempest-VolumesSnapshotListTestJSON-392029018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:12 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d5b94c46-0262-4761-9b4a-16908b75f0ae tempest-VolumesSnapshotListTestJSON-392029018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d5b94c46-0262-4761-9b4a-16908b75f0ae tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d5b94c46-0262-4761-9b4a-16908b75f0ae tempest-VolumesSnapshotListTestJSON-392029018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:12 devstack sudo[87751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:32:12 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:12 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d5b94c46-0262-4761-9b4a-16908b75f0ae tempest-VolumesSnapshotListTestJSON-392029018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.513s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:12 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-d5b94c46-0262-4761-9b4a-16908b75f0ae tempest-VolumesSnapshotListTestJSON-392029018 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:12 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-d5b94c46-0262-4761-9b4a-16908b75f0ae tempest-VolumesSnapshotListTestJSON-392029018 None] Deleted volume successfully. Feb 27 12:32:12 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d5b94c46-0262-4761-9b4a-16908b75f0ae tempest-VolumesSnapshotListTestJSON-392029018 None] Lock "cinder-d21b1fa2-4790-43f4-aa3e-c266617653ca-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:13 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Flow 'volume_create_manager' (8fb81372-1844-4569-b51d-488d161b5028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a64d1d5c-4c33-46f8-a831-669c421158fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a64d1d5c-4c33-46f8-a831-669c421158fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1494717913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b7c5ef5-d70e-41b2-baec-ae6241ad78c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08f5ce3ba6644f129eed97dd49885514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:14Z,use_quota=True,user_id='9c81f21478854df0a7248f107932b200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96724e20-d76f-4a9f-9552-74f44a8b9af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96724e20-d76f-4a9f-9552-74f44a8b9af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e53fc886-53b6-48f7-a579-2891895019a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e53fc886-53b6-48f7-a579-2891895019a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b7c5ef5-d70e-41b2-baec-ae6241ad78c0', 'volume_name': 'volume-7b7c5ef5-d70e-41b2-baec-ae6241ad78c0', 'volume_size': 2}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee7375c-135a-4f0e-ab90-8d3d9ccaed71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee7375c-135a-4f0e-ab90-8d3d9ccaed71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5695c3-c3bd-4852-ac51-22b3038ee666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:13 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Volume 7b7c5ef5-d70e-41b2-baec-ae6241ad78c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b7c5ef5-d70e-41b2-baec-ae6241ad78c0', 'volume_size': 2} Feb 27 12:32:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:13 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1494717913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b7c5ef5-d70e-41b2-baec-ae6241ad78c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08f5ce3ba6644f129eed97dd49885514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:14Z,use_quota=True,user_id='9c81f21478854df0a7248f107932b200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:13 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Creating volume 7b7c5ef5-d70e-41b2-baec-ae6241ad78c0 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:13 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:13 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:13 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:13 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:32:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7b7c5ef5-d70e-41b2-baec-ae6241ad78c0 2147483648 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:13 devstack sudo[87755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7b7c5ef5-d70e-41b2-baec-ae6241ad78c0 2147483648 Feb 27 12:32:13 devstack sudo[87755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:14 devstack sudo[87755]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7b7c5ef5-d70e-41b2-baec-ae6241ad78c0 2147483648" returned: 0 in 0.702s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7b7c5ef5-d70e-41b2-baec-ae6241ad78c0 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:14 devstack sudo[87760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7b7c5ef5-d70e-41b2-baec-ae6241ad78c0 Feb 27 12:32:14 devstack sudo[87760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:15 devstack sudo[87760]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7b7c5ef5-d70e-41b2-baec-ae6241ad78c0" returned: 0 in 0.497s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5695c3-c3bd-4852-ac51-22b3038ee666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b7c5ef5-d70e-41b2-baec-ae6241ad78c0', 'volume_size': 2}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42efd29e-29ea-404b-805e-456cd8b9dfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:15 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Volume volume-7b7c5ef5-d70e-41b2-baec-ae6241ad78c0 (7b7c5ef5-d70e-41b2-baec-ae6241ad78c0): created successfully Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42efd29e-29ea-404b-805e-456cd8b9dfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Flow 'volume_create_manager' (8fb81372-1844-4569-b51d-488d161b5028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:15 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-3ddc5a8d-c618-42ea-9c66-ecf8cae0c930 tempest-VolumesCloneNegativeTest-1401422607 None] Created volume successfully. Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Flow 'volume_create_manager' (6d873c3a-bd7c-4b4f-9b26-ee79e6e2e3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c577df2-d61a-4326-afb0-418e5c1e039a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c577df2-d61a-4326-afb0-418e5c1e039a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-603719152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c20e249-1349-4523-be89-709e20f33085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbb3c97b90494de5b8f84f7bc1c9d978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:15Z,use_quota=True,user_id='0a7b4532dbac41cfa1a2bac9ee64d448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e3115f-5f39-41f1-92ab-4e174d2c15cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e3115f-5f39-41f1-92ab-4e174d2c15cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (218bd6e4-870e-4ed0-862d-f81368ba1055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (218bd6e4-870e-4ed0-862d-f81368ba1055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c20e249-1349-4523-be89-709e20f33085', 'volume_name': 'volume-2c20e249-1349-4523-be89-709e20f33085', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97758e04-0a77-46aa-a3b6-104549d7ca9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97758e04-0a77-46aa-a3b6-104549d7ca9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (650df030-6db0-42f9-8b21-f18e15fb8063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:15 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Volume 2c20e249-1349-4523-be89-709e20f33085: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c20e249-1349-4523-be89-709e20f33085', 'volume_size': 1} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-603719152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c20e249-1349-4523-be89-709e20f33085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbb3c97b90494de5b8f84f7bc1c9d978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:15Z,use_quota=True,user_id='0a7b4532dbac41cfa1a2bac9ee64d448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Creating volume 2c20e249-1349-4523-be89-709e20f33085 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:15 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2c20e249-1349-4523-be89-709e20f33085 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:15 devstack sudo[87763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2c20e249-1349-4523-be89-709e20f33085 1073741824 Feb 27 12:32:15 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Flow 'volume_create_manager' (9a8cb0bc-3947-46ea-b954-36d2cf495b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e30184f-2b17-4698-8537-946cf4f608a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e30184f-2b17-4698-8537-946cf4f608a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-696741442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d26d47-13a3-4ab5-ae66-9f3194943f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbb3c97b90494de5b8f84f7bc1c9d978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:15Z,use_quota=True,user_id='0a7b4532dbac41cfa1a2bac9ee64d448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c07ea8-b389-4258-a856-6c77ea4d7220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c07ea8-b389-4258-a856-6c77ea4d7220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3468d82-97be-4080-8a61-67f70c947dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3468d82-97be-4080-8a61-67f70c947dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d26d47-13a3-4ab5-ae66-9f3194943f8c', 'volume_name': 'volume-05d26d47-13a3-4ab5-ae66-9f3194943f8c', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2034addc-cf51-4b58-8981-1fcab6659243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2034addc-cf51-4b58-8981-1fcab6659243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea694f10-f73e-41c2-afd8-ccf5c86743a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:15 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Volume 05d26d47-13a3-4ab5-ae66-9f3194943f8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d26d47-13a3-4ab5-ae66-9f3194943f8c', 'volume_size': 1} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Flow 'volume_create_manager' (97f08b4c-6681-4c04-b901-166ff56b9ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2395f50f-362c-409e-8070-0b558438fa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2395f50f-362c-409e-8070-0b558438fa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1278958899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d871cb9-37f7-41a6-8621-1cac58cf2607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbb3c97b90494de5b8f84f7bc1c9d978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:16Z,use_quota=True,user_id='0a7b4532dbac41cfa1a2bac9ee64d448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0531a942-beea-4fe2-9938-89454c56a035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0531a942-beea-4fe2-9938-89454c56a035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5069b8cd-cb3d-447b-ad7b-19fb7ec79246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5069b8cd-cb3d-447b-ad7b-19fb7ec79246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d871cb9-37f7-41a6-8621-1cac58cf2607', 'volume_name': 'volume-5d871cb9-37f7-41a6-8621-1cac58cf2607', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d3f97b-5eb8-4826-ad0a-e2ff3538e891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d3f97b-5eb8-4826-ad0a-e2ff3538e891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6c41ea3-5a25-4b1c-8de9-6ca0419193fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:15 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Volume 5d871cb9-37f7-41a6-8621-1cac58cf2607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d871cb9-37f7-41a6-8621-1cac58cf2607', 'volume_size': 1} Feb 27 12:32:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Flow 'volume_create_manager' (ccee1f04-ed1a-4ca2-805a-56de7499e74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aecd83e1-bf5a-441c-8a4b-74cfa8314ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1535532e-340e-42f1-86f1-bc55d6f66fcf tempest-VolumesCloneNegativeTest-1401422607 None] Acquiring lock "cinder-7b7c5ef5-d70e-41b2-baec-ae6241ad78c0-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aecd83e1-bf5a-441c-8a4b-74cfa8314ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-445859004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83fe5392-d394-4445-bb75-ce7dbe69aa38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbb3c97b90494de5b8f84f7bc1c9d978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:16Z,use_quota=True,user_id='0a7b4532dbac41cfa1a2bac9ee64d448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423bd67a-a51e-475f-ba5f-797b58ae1c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423bd67a-a51e-475f-ba5f-797b58ae1c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a280960a-447b-4665-9a76-0b6f99f68ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a280960a-447b-4665-9a76-0b6f99f68ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83fe5392-d394-4445-bb75-ce7dbe69aa38', 'volume_name': 'volume-83fe5392-d394-4445-bb75-ce7dbe69aa38', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43798747-4667-4133-9506-773b2e34031d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:16 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43798747-4667-4133-9506-773b2e34031d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ef3ce7-6cf1-42c9-acad-1dd2098b94a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:16 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Volume 83fe5392-d394-4445-bb75-ce7dbe69aa38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83fe5392-d394-4445-bb75-ce7dbe69aa38', 'volume_size': 1} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1535532e-340e-42f1-86f1-bc55d6f66fcf tempest-VolumesCloneNegativeTest-1401422607 None] Lock "cinder-7b7c5ef5-d70e-41b2-baec-ae6241ad78c0-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2c20e249-1349-4523-be89-709e20f33085 1073741824" returned: 0 in 0.988s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2c20e249-1349-4523-be89-709e20f33085 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:16 devstack sudo[87768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2c20e249-1349-4523-be89-709e20f33085 Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1535532e-340e-42f1-86f1-bc55d6f66fcf tempest-VolumesCloneNegativeTest-1401422607 None] Acquiring lock "cinder-quobyte-7b7c5ef5-d70e-41b2-baec-ae6241ad78c0" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:16 devstack sudo[87768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1535532e-340e-42f1-86f1-bc55d6f66fcf tempest-VolumesCloneNegativeTest-1401422607 None] Lock "cinder-quobyte-7b7c5ef5-d70e-41b2-baec-ae6241ad78c0" acquired by "delete_volume" :: waited 0.024s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d7a33b-fbfb-4d52-873c-010259fbcbd1]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1535532e-340e-42f1-86f1-bc55d6f66fcf tempest-VolumesCloneNegativeTest-1401422607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7b7c5ef5-d70e-41b2-baec-ae6241ad78c0 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Flow 'volume_create_manager' (c41d54cd-2b8b-4a09-8531-eb29cf3d5bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e40f8e9-8174-4499-8799-806c4aba7ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e40f8e9-8174-4499-8799-806c4aba7ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2115959090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cfae657-61a9-4c81-a745-6241efc98a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbb3c97b90494de5b8f84f7bc1c9d978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:16Z,use_quota=True,user_id='0a7b4532dbac41cfa1a2bac9ee64d448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05358e59-4e1d-4957-8d59-c1a5c2509390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05358e59-4e1d-4957-8d59-c1a5c2509390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07ac2329-fd8e-451e-ac21-068ed995d3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07ac2329-fd8e-451e-ac21-068ed995d3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cfae657-61a9-4c81-a745-6241efc98a87', 'volume_name': 'volume-2cfae657-61a9-4c81-a745-6241efc98a87', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0507f89a-e321-4089-bde1-8293e18e717a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:16 devstack sudo[87770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7b7c5ef5-d70e-41b2-baec-ae6241ad78c0 Feb 27 12:32:16 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0507f89a-e321-4089-bde1-8293e18e717a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6256ce3-8c70-4dfe-a630-47239193efd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:16 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Volume 2cfae657-61a9-4c81-a745-6241efc98a87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cfae657-61a9-4c81-a745-6241efc98a87', 'volume_size': 1} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:16 devstack sudo[87768]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2c20e249-1349-4523-be89-709e20f33085" returned: 0 in 0.534s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.356s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-696741442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d26d47-13a3-4ab5-ae66-9f3194943f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbb3c97b90494de5b8f84f7bc1c9d978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:15Z,use_quota=True,user_id='0a7b4532dbac41cfa1a2bac9ee64d448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Creating volume 05d26d47-13a3-4ab5-ae66-9f3194943f8c {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:16 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-05d26d47-13a3-4ab5-ae66-9f3194943f8c 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (650df030-6db0-42f9-8b21-f18e15fb8063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c20e249-1349-4523-be89-709e20f33085', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e850168-8b7b-40ce-90f2-7fa82e3a7607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:16 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Volume volume-2c20e249-1349-4523-be89-709e20f33085 (2c20e249-1349-4523-be89-709e20f33085): created successfully Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e850168-8b7b-40ce-90f2-7fa82e3a7607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Flow 'volume_create_manager' (6d873c3a-bd7c-4b4f-9b26-ee79e6e2e3c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:16 devstack sudo[87774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-05d26d47-13a3-4ab5-ae66-9f3194943f8c 1073741824 Feb 27 12:32:16 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:16 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-ac2e04fb-0034-468e-b1a0-795c87175de9 tempest-CreateVolumesFromImageTest-730118429 None] Created volume successfully. Feb 27 12:32:17 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1535532e-340e-42f1-86f1-bc55d6f66fcf tempest-VolumesCloneNegativeTest-1401422607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7b7c5ef5-d70e-41b2-baec-ae6241ad78c0" returned: 0 in 0.583s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1535532e-340e-42f1-86f1-bc55d6f66fcf tempest-VolumesCloneNegativeTest-1401422607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7b7c5ef5-d70e-41b2-baec-ae6241ad78c0 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:17 devstack sudo[87778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7b7c5ef5-d70e-41b2-baec-ae6241ad78c0 Feb 27 12:32:17 devstack sudo[87778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:17 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-05d26d47-13a3-4ab5-ae66-9f3194943f8c 1073741824" returned: 0 in 0.728s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:17 devstack cinder-volume[83077]: DEBUG dbcounter [-] [83077] Writing DB stats cinder:SELECT=158,cinder:INSERT=54,cinder:UPDATE=205,cinder:DELETE=12 {{(pid=83077) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:32:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-05d26d47-13a3-4ab5-ae66-9f3194943f8c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:17 devstack sudo[87778]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1535532e-340e-42f1-86f1-bc55d6f66fcf tempest-VolumesCloneNegativeTest-1401422607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7b7c5ef5-d70e-41b2-baec-ae6241ad78c0" returned: 0 in 0.627s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1535532e-340e-42f1-86f1-bc55d6f66fcf tempest-VolumesCloneNegativeTest-1401422607 None] Lock "cinder-quobyte-7b7c5ef5-d70e-41b2-baec-ae6241ad78c0" released by "delete_volume" :: held 1.261s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:17 devstack sudo[87801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-05d26d47-13a3-4ab5-ae66-9f3194943f8c Feb 27 12:32:17 devstack sudo[87801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:17 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-1535532e-340e-42f1-86f1-bc55d6f66fcf tempest-VolumesCloneNegativeTest-1401422607 None] Created reservations ['421e70fc-bf7f-47f2-a07e-1eeb2d758ef8', '198b28c6-393a-4044-aff1-9c6abeff68b2', 'cadc4b9a-81e2-409c-9791-69b24bf69c33', '011facd3-1835-4874-a473-412703650ce0'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1535532e-340e-42f1-86f1-bc55d6f66fcf tempest-VolumesCloneNegativeTest-1401422607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1535532e-340e-42f1-86f1-bc55d6f66fcf tempest-VolumesCloneNegativeTest-1401422607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:17 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-1535532e-340e-42f1-86f1-bc55d6f66fcf tempest-VolumesCloneNegativeTest-1401422607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:17 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-1535532e-340e-42f1-86f1-bc55d6f66fcf tempest-VolumesCloneNegativeTest-1401422607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1535532e-340e-42f1-86f1-bc55d6f66fcf tempest-VolumesCloneNegativeTest-1401422607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1535532e-340e-42f1-86f1-bc55d6f66fcf tempest-VolumesCloneNegativeTest-1401422607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:17 devstack sudo[87803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:32:17 devstack sudo[87803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:18 devstack sudo[87801]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-05d26d47-13a3-4ab5-ae66-9f3194943f8c" returned: 0 in 0.478s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:18 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:32:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.355s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:18 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1278958899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d871cb9-37f7-41a6-8621-1cac58cf2607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbb3c97b90494de5b8f84f7bc1c9d978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:16Z,use_quota=True,user_id='0a7b4532dbac41cfa1a2bac9ee64d448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:18 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Creating volume 5d871cb9-37f7-41a6-8621-1cac58cf2607 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:18 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:18 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:18 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:18 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:32:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d871cb9-37f7-41a6-8621-1cac58cf2607 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:18 devstack sudo[87806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d871cb9-37f7-41a6-8621-1cac58cf2607 1073741824 Feb 27 12:32:18 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea694f10-f73e-41c2-afd8-ccf5c86743a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d26d47-13a3-4ab5-ae66-9f3194943f8c', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:18 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:18 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7b87f7-e71f-4abb-aa86-0f901ad14e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:18 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Volume volume-05d26d47-13a3-4ab5-ae66-9f3194943f8c (05d26d47-13a3-4ab5-ae66-9f3194943f8c): created successfully Feb 27 12:32:18 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7b87f7-e71f-4abb-aa86-0f901ad14e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:18 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Flow 'volume_create_manager' (9a8cb0bc-3947-46ea-b954-36d2cf495b19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:18 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-c41f84b2-1c3e-44a4-93af-95f429f15edb tempest-CreateVolumesFromImageTest-730118429 None] Created volume successfully. Feb 27 12:32:18 devstack sudo[87803]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1535532e-340e-42f1-86f1-bc55d6f66fcf tempest-VolumesCloneNegativeTest-1401422607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.524s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:18 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-1535532e-340e-42f1-86f1-bc55d6f66fcf tempest-VolumesCloneNegativeTest-1401422607 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:18 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-1535532e-340e-42f1-86f1-bc55d6f66fcf tempest-VolumesCloneNegativeTest-1401422607 None] Deleted volume successfully. Feb 27 12:32:18 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1535532e-340e-42f1-86f1-bc55d6f66fcf tempest-VolumesCloneNegativeTest-1401422607 None] Lock "cinder-7b7c5ef5-d70e-41b2-baec-ae6241ad78c0-delete_volume" released by "delete_volume" :: held 1.974s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:18 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d871cb9-37f7-41a6-8621-1cac58cf2607 1073741824" returned: 0 in 0.637s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d871cb9-37f7-41a6-8621-1cac58cf2607 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:18 devstack sudo[87812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d871cb9-37f7-41a6-8621-1cac58cf2607 Feb 27 12:32:18 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:19 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d871cb9-37f7-41a6-8621-1cac58cf2607" returned: 0 in 0.550s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:32:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.058s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-445859004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83fe5392-d394-4445-bb75-ce7dbe69aa38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbb3c97b90494de5b8f84f7bc1c9d978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:16Z,use_quota=True,user_id='0a7b4532dbac41cfa1a2bac9ee64d448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Creating volume 83fe5392-d394-4445-bb75-ce7dbe69aa38 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:19 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:32:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-83fe5392-d394-4445-bb75-ce7dbe69aa38 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6c41ea3-5a25-4b1c-8de9-6ca0419193fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d871cb9-37f7-41a6-8621-1cac58cf2607', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:19 devstack sudo[87815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-83fe5392-d394-4445-bb75-ce7dbe69aa38 1073741824 Feb 27 12:32:19 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc96cdb-a2fc-42f5-b1b3-b437eb5982ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:19 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Volume volume-5d871cb9-37f7-41a6-8621-1cac58cf2607 (5d871cb9-37f7-41a6-8621-1cac58cf2607): created successfully Feb 27 12:32:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc96cdb-a2fc-42f5-b1b3-b437eb5982ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Flow 'volume_create_manager' (97f08b4c-6681-4c04-b901-166ff56b9ad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:19 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-0e434ea4-1bda-4053-9300-bf571bcbf123 tempest-CreateVolumesFromImageTest-730118429 None] Created volume successfully. Feb 27 12:32:19 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-83fe5392-d394-4445-bb75-ce7dbe69aa38 1073741824" returned: 0 in 0.590s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-83fe5392-d394-4445-bb75-ce7dbe69aa38 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:20 devstack sudo[87820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-83fe5392-d394-4445-bb75-ce7dbe69aa38 Feb 27 12:32:20 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:20 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-83fe5392-d394-4445-bb75-ce7dbe69aa38" returned: 0 in 0.513s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:20 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:32:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.948s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:20 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2115959090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cfae657-61a9-4c81-a745-6241efc98a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbb3c97b90494de5b8f84f7bc1c9d978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:16Z,use_quota=True,user_id='0a7b4532dbac41cfa1a2bac9ee64d448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:20 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Creating volume 2cfae657-61a9-4c81-a745-6241efc98a87 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:20 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:20 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:20 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:20 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:32:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2cfae657-61a9-4c81-a745-6241efc98a87 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:20 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ef3ce7-6cf1-42c9-acad-1dd2098b94a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83fe5392-d394-4445-bb75-ce7dbe69aa38', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:20 devstack sudo[87823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2cfae657-61a9-4c81-a745-6241efc98a87 1073741824 Feb 27 12:32:20 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:20 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a2ddd92-7d74-48e3-b9bc-b4942f9d22bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:20 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Volume volume-83fe5392-d394-4445-bb75-ce7dbe69aa38 (83fe5392-d394-4445-bb75-ce7dbe69aa38): created successfully Feb 27 12:32:20 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a2ddd92-7d74-48e3-b9bc-b4942f9d22bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:20 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Flow 'volume_create_manager' (ccee1f04-ed1a-4ca2-805a-56de7499e74c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:20 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-a438c605-7e60-43fa-baa5-32f9a90fba32 tempest-CreateVolumesFromImageTest-730118429 None] Created volume successfully. Feb 27 12:32:21 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2cfae657-61a9-4c81-a745-6241efc98a87 1073741824" returned: 0 in 0.755s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2cfae657-61a9-4c81-a745-6241efc98a87 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:21 devstack sudo[87829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2cfae657-61a9-4c81-a745-6241efc98a87 Feb 27 12:32:21 devstack sudo[87829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Flow 'volume_create_manager' (1e6fed45-1fdb-4d27-81db-8d645b3bdf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dee9c87-575f-4d51-9959-8392c93b18cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dee9c87-575f-4d51-9959-8392c93b18cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1741440207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7164534-0d95-4079-b53d-b8b7f0a684a0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='655c8c0f922e44f3b9ad9120a1db37bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:21Z,use_quota=True,user_id='d8bd1aefa8014a9c8f4d8be50a476d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9689c217-dad2-4cf1-8499-4299e1466ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9689c217-dad2-4cf1-8499-4299e1466ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a95393e-8c1a-4d7f-af75-4117ece8bdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a95393e-8c1a-4d7f-af75-4117ece8bdc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7164534-0d95-4079-b53d-b8b7f0a684a0', 'volume_name': 'volume-f7164534-0d95-4079-b53d-b8b7f0a684a0', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1daadb69-21d0-4fe1-ab22-12a4ab92c2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1daadb69-21d0-4fe1-ab22-12a4ab92c2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (698121de-8da5-42ea-ab16-e2efc4a3b37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:21 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Volume f7164534-0d95-4079-b53d-b8b7f0a684a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7164534-0d95-4079-b53d-b8b7f0a684a0', 'volume_size': 1} Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:21 devstack sudo[87829]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2cfae657-61a9-4c81-a745-6241efc98a87" returned: 0 in 0.589s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.436s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1741440207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7164534-0d95-4079-b53d-b8b7f0a684a0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='655c8c0f922e44f3b9ad9120a1db37bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:21Z,use_quota=True,user_id='d8bd1aefa8014a9c8f4d8be50a476d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Creating volume f7164534-0d95-4079-b53d-b8b7f0a684a0 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:21 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f7164534-0d95-4079-b53d-b8b7f0a684a0 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:21 devstack sudo[87835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f7164534-0d95-4079-b53d-b8b7f0a684a0 1073741824 Feb 27 12:32:21 devstack sudo[87835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6256ce3-8c70-4dfe-a630-47239193efd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cfae657-61a9-4c81-a745-6241efc98a87', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f6cdd1-256c-4007-a4f4-9a189e9943b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:21 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Volume volume-2cfae657-61a9-4c81-a745-6241efc98a87 (2cfae657-61a9-4c81-a745-6241efc98a87): created successfully Feb 27 12:32:21 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f6cdd1-256c-4007-a4f4-9a189e9943b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Flow 'volume_create_manager' (c41d54cd-2b8b-4a09-8531-eb29cf3d5bf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:22 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-4e9c3209-cd17-4f48-bce7-dd9b980ee1d5 tempest-CreateVolumesFromImageTest-730118429 None] Created volume successfully. Feb 27 12:32:22 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc0dc6af-83a7-4579-b245-bc1cf184e2fe tempest-CreateVolumesFromImageTest-730118429 None] Acquiring lock "cinder-2cfae657-61a9-4c81-a745-6241efc98a87-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:22 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc0dc6af-83a7-4579-b245-bc1cf184e2fe tempest-CreateVolumesFromImageTest-730118429 None] Lock "cinder-2cfae657-61a9-4c81-a745-6241efc98a87-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:22 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc0dc6af-83a7-4579-b245-bc1cf184e2fe tempest-CreateVolumesFromImageTest-730118429 None] Acquiring lock "cinder-quobyte-2cfae657-61a9-4c81-a745-6241efc98a87" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:22 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc0dc6af-83a7-4579-b245-bc1cf184e2fe tempest-CreateVolumesFromImageTest-730118429 None] Lock "cinder-quobyte-2cfae657-61a9-4c81-a745-6241efc98a87" acquired by "delete_volume" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:22 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2e98d8-6f52-44b1-87d5-beeef693f271]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc0dc6af-83a7-4579-b245-bc1cf184e2fe tempest-CreateVolumesFromImageTest-730118429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2cfae657-61a9-4c81-a745-6241efc98a87 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:22 devstack sudo[87837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2cfae657-61a9-4c81-a745-6241efc98a87 Feb 27 12:32:22 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:22 devstack sudo[87835]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f7164534-0d95-4079-b53d-b8b7f0a684a0 1073741824" returned: 0 in 0.567s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f7164534-0d95-4079-b53d-b8b7f0a684a0 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:22 devstack sudo[87842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f7164534-0d95-4079-b53d-b8b7f0a684a0 Feb 27 12:32:22 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:22 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc0dc6af-83a7-4579-b245-bc1cf184e2fe tempest-CreateVolumesFromImageTest-730118429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2cfae657-61a9-4c81-a745-6241efc98a87" returned: 0 in 0.510s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc0dc6af-83a7-4579-b245-bc1cf184e2fe tempest-CreateVolumesFromImageTest-730118429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2cfae657-61a9-4c81-a745-6241efc98a87 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:22 devstack sudo[87847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2cfae657-61a9-4c81-a745-6241efc98a87 Feb 27 12:32:22 devstack sudo[87847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:23 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f7164534-0d95-4079-b53d-b8b7f0a684a0" returned: 0 in 0.486s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:23 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:32:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:23 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (698121de-8da5-42ea-ab16-e2efc4a3b37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7164534-0d95-4079-b53d-b8b7f0a684a0', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:23 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71790e30-99f0-4a62-9ced-c30335551cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:23 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Volume volume-f7164534-0d95-4079-b53d-b8b7f0a684a0 (f7164534-0d95-4079-b53d-b8b7f0a684a0): created successfully Feb 27 12:32:23 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71790e30-99f0-4a62-9ced-c30335551cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:23 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Flow 'volume_create_manager' (1e6fed45-1fdb-4d27-81db-8d645b3bdf2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:23 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-07ed4be3-871c-4e93-9ae9-cddb20e6b1af tempest-VolumesGetTest-1017574975 None] Created volume successfully. Feb 27 12:32:23 devstack sudo[87847]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc0dc6af-83a7-4579-b245-bc1cf184e2fe tempest-CreateVolumesFromImageTest-730118429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2cfae657-61a9-4c81-a745-6241efc98a87" returned: 0 in 0.458s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:23 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc0dc6af-83a7-4579-b245-bc1cf184e2fe tempest-CreateVolumesFromImageTest-730118429 None] Lock "cinder-quobyte-2cfae657-61a9-4c81-a745-6241efc98a87" released by "delete_volume" :: held 0.988s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:23 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-bc0dc6af-83a7-4579-b245-bc1cf184e2fe tempest-CreateVolumesFromImageTest-730118429 None] Created reservations ['5075a9ed-170b-4b12-a642-37f0b5da8a59', '1cb94210-375d-4dcf-a12b-22122c57c1ff', '20f3236c-6137-494e-a613-2d48b77b7709', '9b647c78-2d48-4cfd-98c1-8445a2f5f6a1'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bc0dc6af-83a7-4579-b245-bc1cf184e2fe tempest-CreateVolumesFromImageTest-730118429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bc0dc6af-83a7-4579-b245-bc1cf184e2fe tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:23 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bc0dc6af-83a7-4579-b245-bc1cf184e2fe tempest-CreateVolumesFromImageTest-730118429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:23 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bc0dc6af-83a7-4579-b245-bc1cf184e2fe tempest-CreateVolumesFromImageTest-730118429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bc0dc6af-83a7-4579-b245-bc1cf184e2fe tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc0dc6af-83a7-4579-b245-bc1cf184e2fe tempest-CreateVolumesFromImageTest-730118429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:23 devstack sudo[87851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:32:23 devstack sudo[87851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:23 devstack sudo[87851]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc0dc6af-83a7-4579-b245-bc1cf184e2fe tempest-CreateVolumesFromImageTest-730118429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.642s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:23 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-bc0dc6af-83a7-4579-b245-bc1cf184e2fe tempest-CreateVolumesFromImageTest-730118429 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:23 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-bc0dc6af-83a7-4579-b245-bc1cf184e2fe tempest-CreateVolumesFromImageTest-730118429 None] Deleted volume successfully. Feb 27 12:32:23 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc0dc6af-83a7-4579-b245-bc1cf184e2fe tempest-CreateVolumesFromImageTest-730118429 None] Lock "cinder-2cfae657-61a9-4c81-a745-6241efc98a87-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Flow 'volume_create_manager' (4162a901-c261-49b7-89d6-9883203949f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba450662-4bd0-401d-a623-2c8c635324cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba450662-4bd0-401d-a623-2c8c635324cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1598829353',display_name='tempest-VolumesGetTest-Volume-1981992912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91299f43-e54b-4e0b-bafa-bf8b85325285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='655c8c0f922e44f3b9ad9120a1db37bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:24Z,use_quota=True,user_id='d8bd1aefa8014a9c8f4d8be50a476d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38c32bf7-afc1-4ac1-8456-dce0d930f27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38c32bf7-afc1-4ac1-8456-dce0d930f27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a52d4f09-25e8-4645-853c-7f30aadbe252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a52d4f09-25e8-4645-853c-7f30aadbe252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91299f43-e54b-4e0b-bafa-bf8b85325285', 'volume_name': 'volume-91299f43-e54b-4e0b-bafa-bf8b85325285', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625eb80d-9634-44d9-8442-68efd5983906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625eb80d-9634-44d9-8442-68efd5983906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afbd152-fa94-44a0-b161-30b0e5cdd551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:24 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Volume 91299f43-e54b-4e0b-bafa-bf8b85325285: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91299f43-e54b-4e0b-bafa-bf8b85325285', 'volume_size': 1} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1598829353',display_name='tempest-VolumesGetTest-Volume-1981992912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91299f43-e54b-4e0b-bafa-bf8b85325285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='655c8c0f922e44f3b9ad9120a1db37bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:24Z,use_quota=True,user_id='d8bd1aefa8014a9c8f4d8be50a476d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Creating volume 91299f43-e54b-4e0b-bafa-bf8b85325285 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:24 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-91299f43-e54b-4e0b-bafa-bf8b85325285 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:24 devstack sudo[87882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-91299f43-e54b-4e0b-bafa-bf8b85325285 1073741824 Feb 27 12:32:24 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-93580e75-93f1-4e34-bf6a-e2a2da1e998c tempest-CreateVolumesFromImageTest-730118429 None] Acquiring lock "cinder-83fe5392-d394-4445-bb75-ce7dbe69aa38-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-93580e75-93f1-4e34-bf6a-e2a2da1e998c tempest-CreateVolumesFromImageTest-730118429 None] Lock "cinder-83fe5392-d394-4445-bb75-ce7dbe69aa38-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-93580e75-93f1-4e34-bf6a-e2a2da1e998c tempest-CreateVolumesFromImageTest-730118429 None] Acquiring lock "cinder-quobyte-83fe5392-d394-4445-bb75-ce7dbe69aa38" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-93580e75-93f1-4e34-bf6a-e2a2da1e998c tempest-CreateVolumesFromImageTest-730118429 None] Lock "cinder-quobyte-83fe5392-d394-4445-bb75-ce7dbe69aa38" acquired by "delete_volume" :: waited 0.006s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52ddb39-e2c8-423b-b886-61a3e4c99cff]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-93580e75-93f1-4e34-bf6a-e2a2da1e998c tempest-CreateVolumesFromImageTest-730118429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-83fe5392-d394-4445-bb75-ce7dbe69aa38 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:24 devstack sudo[87884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-83fe5392-d394-4445-bb75-ce7dbe69aa38 Feb 27 12:32:24 devstack sudo[87884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:24 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-91299f43-e54b-4e0b-bafa-bf8b85325285 1073741824" returned: 0 in 0.543s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-91299f43-e54b-4e0b-bafa-bf8b85325285 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:24 devstack sudo[87889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-91299f43-e54b-4e0b-bafa-bf8b85325285 Feb 27 12:32:24 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:24 devstack sudo[87884]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-93580e75-93f1-4e34-bf6a-e2a2da1e998c tempest-CreateVolumesFromImageTest-730118429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-83fe5392-d394-4445-bb75-ce7dbe69aa38" returned: 0 in 0.496s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-93580e75-93f1-4e34-bf6a-e2a2da1e998c tempest-CreateVolumesFromImageTest-730118429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-83fe5392-d394-4445-bb75-ce7dbe69aa38 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:24 devstack sudo[87894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-83fe5392-d394-4445-bb75-ce7dbe69aa38 Feb 27 12:32:24 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:25 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-91299f43-e54b-4e0b-bafa-bf8b85325285" returned: 0 in 0.403s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:25 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:32:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afbd152-fa94-44a0-b161-30b0e5cdd551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91299f43-e54b-4e0b-bafa-bf8b85325285', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (914e2508-fe13-4b8c-9fd6-ffa6160fd204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:25 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Volume volume-91299f43-e54b-4e0b-bafa-bf8b85325285 (91299f43-e54b-4e0b-bafa-bf8b85325285): created successfully Feb 27 12:32:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (914e2508-fe13-4b8c-9fd6-ffa6160fd204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Flow 'volume_create_manager' (4162a901-c261-49b7-89d6-9883203949f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:25 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-2da49515-d70f-49ba-b21c-815037e9eb71 tempest-VolumesGetTest-1017574975 None] Created volume successfully. Feb 27 12:32:25 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-93580e75-93f1-4e34-bf6a-e2a2da1e998c tempest-CreateVolumesFromImageTest-730118429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-83fe5392-d394-4445-bb75-ce7dbe69aa38" returned: 0 in 0.458s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:25 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-93580e75-93f1-4e34-bf6a-e2a2da1e998c tempest-CreateVolumesFromImageTest-730118429 None] Lock "cinder-quobyte-83fe5392-d394-4445-bb75-ce7dbe69aa38" released by "delete_volume" :: held 0.977s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:25 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-93580e75-93f1-4e34-bf6a-e2a2da1e998c tempest-CreateVolumesFromImageTest-730118429 None] Created reservations ['54a8728b-5ad2-40ee-a09b-0b44060a7077', '5df9106f-4afd-4cc0-82ce-f996e7497624', 'eb9834ba-90d3-48ac-a511-70276d0e72df', 'd2b82e94-6230-406f-9b7f-5dae8cccae78'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-93580e75-93f1-4e34-bf6a-e2a2da1e998c tempest-CreateVolumesFromImageTest-730118429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-93580e75-93f1-4e34-bf6a-e2a2da1e998c tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:25 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-93580e75-93f1-4e34-bf6a-e2a2da1e998c tempest-CreateVolumesFromImageTest-730118429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:25 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-93580e75-93f1-4e34-bf6a-e2a2da1e998c tempest-CreateVolumesFromImageTest-730118429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-93580e75-93f1-4e34-bf6a-e2a2da1e998c tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-93580e75-93f1-4e34-bf6a-e2a2da1e998c tempest-CreateVolumesFromImageTest-730118429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:25 devstack sudo[87898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:32:25 devstack sudo[87898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:25 devstack sudo[87898]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-93580e75-93f1-4e34-bf6a-e2a2da1e998c tempest-CreateVolumesFromImageTest-730118429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.393s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:25 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-93580e75-93f1-4e34-bf6a-e2a2da1e998c tempest-CreateVolumesFromImageTest-730118429 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:25 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-93580e75-93f1-4e34-bf6a-e2a2da1e998c tempest-CreateVolumesFromImageTest-730118429 None] Deleted volume successfully. Feb 27 12:32:25 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-93580e75-93f1-4e34-bf6a-e2a2da1e998c tempest-CreateVolumesFromImageTest-730118429 None] Lock "cinder-83fe5392-d394-4445-bb75-ce7dbe69aa38-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:26 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-78854e11-f179-4b66-9229-a9b9798ac3e0 tempest-VolumesGetTest-1017574975 None] Acquiring lock "cinder-91299f43-e54b-4e0b-bafa-bf8b85325285-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:26 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-78854e11-f179-4b66-9229-a9b9798ac3e0 tempest-VolumesGetTest-1017574975 None] Lock "cinder-91299f43-e54b-4e0b-bafa-bf8b85325285-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:26 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-78854e11-f179-4b66-9229-a9b9798ac3e0 tempest-VolumesGetTest-1017574975 None] Acquiring lock "cinder-quobyte-91299f43-e54b-4e0b-bafa-bf8b85325285" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:26 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-78854e11-f179-4b66-9229-a9b9798ac3e0 tempest-VolumesGetTest-1017574975 None] Lock "cinder-quobyte-91299f43-e54b-4e0b-bafa-bf8b85325285" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:26 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[577a4773-cec3-4032-8422-ff7d1bb29029]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-78854e11-f179-4b66-9229-a9b9798ac3e0 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-91299f43-e54b-4e0b-bafa-bf8b85325285 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:26 devstack sudo[87901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-91299f43-e54b-4e0b-bafa-bf8b85325285 Feb 27 12:32:26 devstack sudo[87901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:26 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-c0bbd979-40e1-4667-94f1-be991843d1b0 tempest-CreateVolumesFromImageTest-730118429 None] Acquiring lock "cinder-5d871cb9-37f7-41a6-8621-1cac58cf2607-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:26 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-c0bbd979-40e1-4667-94f1-be991843d1b0 tempest-CreateVolumesFromImageTest-730118429 None] Lock "cinder-5d871cb9-37f7-41a6-8621-1cac58cf2607-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:26 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-c0bbd979-40e1-4667-94f1-be991843d1b0 tempest-CreateVolumesFromImageTest-730118429 None] Acquiring lock "cinder-quobyte-5d871cb9-37f7-41a6-8621-1cac58cf2607" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:26 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-c0bbd979-40e1-4667-94f1-be991843d1b0 tempest-CreateVolumesFromImageTest-730118429 None] Lock "cinder-quobyte-5d871cb9-37f7-41a6-8621-1cac58cf2607" acquired by "delete_volume" :: waited 0.022s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:26 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d529f67-a714-45e3-802d-d185a30d2222]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c0bbd979-40e1-4667-94f1-be991843d1b0 tempest-CreateVolumesFromImageTest-730118429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d871cb9-37f7-41a6-8621-1cac58cf2607 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:26 devstack sudo[87909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d871cb9-37f7-41a6-8621-1cac58cf2607 Feb 27 12:32:26 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:26 devstack sudo[87901]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-78854e11-f179-4b66-9229-a9b9798ac3e0 tempest-VolumesGetTest-1017574975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-91299f43-e54b-4e0b-bafa-bf8b85325285" returned: 0 in 0.526s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-78854e11-f179-4b66-9229-a9b9798ac3e0 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-91299f43-e54b-4e0b-bafa-bf8b85325285 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:26 devstack sudo[87926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-91299f43-e54b-4e0b-bafa-bf8b85325285 Feb 27 12:32:26 devstack sudo[87926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:27 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c0bbd979-40e1-4667-94f1-be991843d1b0 tempest-CreateVolumesFromImageTest-730118429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d871cb9-37f7-41a6-8621-1cac58cf2607" returned: 0 in 0.499s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c0bbd979-40e1-4667-94f1-be991843d1b0 tempest-CreateVolumesFromImageTest-730118429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d871cb9-37f7-41a6-8621-1cac58cf2607 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:27 devstack sudo[87953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d871cb9-37f7-41a6-8621-1cac58cf2607 Feb 27 12:32:27 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:27 devstack sudo[87926]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-78854e11-f179-4b66-9229-a9b9798ac3e0 tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-91299f43-e54b-4e0b-bafa-bf8b85325285" returned: 0 in 0.429s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-78854e11-f179-4b66-9229-a9b9798ac3e0 tempest-VolumesGetTest-1017574975 None] Lock "cinder-quobyte-91299f43-e54b-4e0b-bafa-bf8b85325285" released by "delete_volume" :: held 0.979s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-78854e11-f179-4b66-9229-a9b9798ac3e0 tempest-VolumesGetTest-1017574975 None] Created reservations ['ddd11326-b720-46a6-a4d1-3538aa2ea559', '4b210989-e8df-4f6c-9aef-4944d0b24675', '6f0ef774-bf75-497f-970d-c38acc43a54e', 'c7b8fc17-1d1a-4d86-922d-14f623559ffa'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-78854e11-f179-4b66-9229-a9b9798ac3e0 tempest-VolumesGetTest-1017574975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-78854e11-f179-4b66-9229-a9b9798ac3e0 tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-78854e11-f179-4b66-9229-a9b9798ac3e0 tempest-VolumesGetTest-1017574975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-78854e11-f179-4b66-9229-a9b9798ac3e0 tempest-VolumesGetTest-1017574975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-78854e11-f179-4b66-9229-a9b9798ac3e0 tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-78854e11-f179-4b66-9229-a9b9798ac3e0 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:27 devstack sudo[87956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:32:27 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6d382a9d-113b-48b0-809f-28473787df9e tempest-VolumesGetTest-1017574975 None] Acquiring lock "cinder-f7164534-0d95-4079-b53d-b8b7f0a684a0-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6d382a9d-113b-48b0-809f-28473787df9e tempest-VolumesGetTest-1017574975 None] Lock "cinder-f7164534-0d95-4079-b53d-b8b7f0a684a0-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6d382a9d-113b-48b0-809f-28473787df9e tempest-VolumesGetTest-1017574975 None] Acquiring lock "cinder-quobyte-f7164534-0d95-4079-b53d-b8b7f0a684a0" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6d382a9d-113b-48b0-809f-28473787df9e tempest-VolumesGetTest-1017574975 None] Lock "cinder-quobyte-f7164534-0d95-4079-b53d-b8b7f0a684a0" acquired by "delete_volume" :: waited 0.007s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f713fbe-86f7-47d3-bcab-59bca2d25257]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6d382a9d-113b-48b0-809f-28473787df9e tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f7164534-0d95-4079-b53d-b8b7f0a684a0 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:27 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c0bbd979-40e1-4667-94f1-be991843d1b0 tempest-CreateVolumesFromImageTest-730118429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d871cb9-37f7-41a6-8621-1cac58cf2607" returned: 0 in 0.496s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-c0bbd979-40e1-4667-94f1-be991843d1b0 tempest-CreateVolumesFromImageTest-730118429 None] Lock "cinder-quobyte-5d871cb9-37f7-41a6-8621-1cac58cf2607" released by "delete_volume" :: held 1.019s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:27 devstack sudo[87959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f7164534-0d95-4079-b53d-b8b7f0a684a0 Feb 27 12:32:27 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-c0bbd979-40e1-4667-94f1-be991843d1b0 tempest-CreateVolumesFromImageTest-730118429 None] Created reservations ['3a4637ae-bb3b-4a99-a577-d56ff038fb4b', '31e84fd1-759c-4017-9ca2-dbc7203460a6', '7aa33a18-dffa-489a-99aa-60605362cb33', '544cffc1-22ff-4223-a170-ebb90057e7a0'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c0bbd979-40e1-4667-94f1-be991843d1b0 tempest-CreateVolumesFromImageTest-730118429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c0bbd979-40e1-4667-94f1-be991843d1b0 tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c0bbd979-40e1-4667-94f1-be991843d1b0 tempest-CreateVolumesFromImageTest-730118429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c0bbd979-40e1-4667-94f1-be991843d1b0 tempest-CreateVolumesFromImageTest-730118429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c0bbd979-40e1-4667-94f1-be991843d1b0 tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c0bbd979-40e1-4667-94f1-be991843d1b0 tempest-CreateVolumesFromImageTest-730118429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:27 devstack sudo[87961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:32:27 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:27 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-78854e11-f179-4b66-9229-a9b9798ac3e0 tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.470s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-78854e11-f179-4b66-9229-a9b9798ac3e0 tempest-VolumesGetTest-1017574975 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:27 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-78854e11-f179-4b66-9229-a9b9798ac3e0 tempest-VolumesGetTest-1017574975 None] Deleted volume successfully. Feb 27 12:32:27 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-78854e11-f179-4b66-9229-a9b9798ac3e0 tempest-VolumesGetTest-1017574975 None] Lock "cinder-91299f43-e54b-4e0b-bafa-bf8b85325285-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:28 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6d382a9d-113b-48b0-809f-28473787df9e tempest-VolumesGetTest-1017574975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f7164534-0d95-4079-b53d-b8b7f0a684a0" returned: 0 in 0.574s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6d382a9d-113b-48b0-809f-28473787df9e tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f7164534-0d95-4079-b53d-b8b7f0a684a0 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:28 devstack sudo[87967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f7164534-0d95-4079-b53d-b8b7f0a684a0 Feb 27 12:32:28 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:28 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c0bbd979-40e1-4667-94f1-be991843d1b0 tempest-CreateVolumesFromImageTest-730118429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.509s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:28 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-c0bbd979-40e1-4667-94f1-be991843d1b0 tempest-CreateVolumesFromImageTest-730118429 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:28 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-c0bbd979-40e1-4667-94f1-be991843d1b0 tempest-CreateVolumesFromImageTest-730118429 None] Deleted volume successfully. Feb 27 12:32:28 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-c0bbd979-40e1-4667-94f1-be991843d1b0 tempest-CreateVolumesFromImageTest-730118429 None] Lock "cinder-5d871cb9-37f7-41a6-8621-1cac58cf2607-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:28 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6d382a9d-113b-48b0-809f-28473787df9e tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f7164534-0d95-4079-b53d-b8b7f0a684a0" returned: 0 in 0.456s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:28 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6d382a9d-113b-48b0-809f-28473787df9e tempest-VolumesGetTest-1017574975 None] Lock "cinder-quobyte-f7164534-0d95-4079-b53d-b8b7f0a684a0" released by "delete_volume" :: held 1.068s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:28 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-6d382a9d-113b-48b0-809f-28473787df9e tempest-VolumesGetTest-1017574975 None] Created reservations ['443fde3f-4792-4807-a8db-14981f4c0b9c', '129df776-7b96-438a-9c95-7458f95854f2', '2d65c767-2b17-47b3-819f-8d79f7383723', '5ff93f9d-ec1a-4518-9386-0ab73bc04380'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6d382a9d-113b-48b0-809f-28473787df9e tempest-VolumesGetTest-1017574975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6d382a9d-113b-48b0-809f-28473787df9e tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:28 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6d382a9d-113b-48b0-809f-28473787df9e tempest-VolumesGetTest-1017574975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:28 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6d382a9d-113b-48b0-809f-28473787df9e tempest-VolumesGetTest-1017574975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6d382a9d-113b-48b0-809f-28473787df9e tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6d382a9d-113b-48b0-809f-28473787df9e tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:28 devstack sudo[87971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:32:28 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:28 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc0f53f9-7fcc-4840-9766-fe35fc08913a tempest-CreateVolumesFromImageTest-730118429 None] Acquiring lock "cinder-05d26d47-13a3-4ab5-ae66-9f3194943f8c-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:28 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc0f53f9-7fcc-4840-9766-fe35fc08913a tempest-CreateVolumesFromImageTest-730118429 None] Lock "cinder-05d26d47-13a3-4ab5-ae66-9f3194943f8c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:28 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc0f53f9-7fcc-4840-9766-fe35fc08913a tempest-CreateVolumesFromImageTest-730118429 None] Acquiring lock "cinder-quobyte-05d26d47-13a3-4ab5-ae66-9f3194943f8c" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:28 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc0f53f9-7fcc-4840-9766-fe35fc08913a tempest-CreateVolumesFromImageTest-730118429 None] Lock "cinder-quobyte-05d26d47-13a3-4ab5-ae66-9f3194943f8c" acquired by "delete_volume" :: waited 0.007s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:28 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3bce65-8aaf-444e-af1d-31342622e1da]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc0f53f9-7fcc-4840-9766-fe35fc08913a tempest-CreateVolumesFromImageTest-730118429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-05d26d47-13a3-4ab5-ae66-9f3194943f8c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:28 devstack sudo[87974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-05d26d47-13a3-4ab5-ae66-9f3194943f8c Feb 27 12:32:28 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:29 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6d382a9d-113b-48b0-809f-28473787df9e tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.673s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:29 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-6d382a9d-113b-48b0-809f-28473787df9e tempest-VolumesGetTest-1017574975 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:29 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-6d382a9d-113b-48b0-809f-28473787df9e tempest-VolumesGetTest-1017574975 None] Deleted volume successfully. Feb 27 12:32:29 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6d382a9d-113b-48b0-809f-28473787df9e tempest-VolumesGetTest-1017574975 None] Lock "cinder-f7164534-0d95-4079-b53d-b8b7f0a684a0-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:29 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:30 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Flow 'volume_create_manager' (3a1b96fe-b1f6-4118-8506-89eaa044e4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773fa38f-d711-43d5-8586-cd401b776878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc0f53f9-7fcc-4840-9766-fe35fc08913a tempest-CreateVolumesFromImageTest-730118429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-05d26d47-13a3-4ab5-ae66-9f3194943f8c" returned: 0 in 1.306s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc0f53f9-7fcc-4840-9766-fe35fc08913a tempest-CreateVolumesFromImageTest-730118429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-05d26d47-13a3-4ab5-ae66-9f3194943f8c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773fa38f-d711-43d5-8586-cd401b776878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1457620668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9de99f4-09ea-42a2-a90b-091add649720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='655c8c0f922e44f3b9ad9120a1db37bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:30Z,use_quota=True,user_id='d8bd1aefa8014a9c8f4d8be50a476d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290a0cc5-0275-4a89-9249-6fa0a92b34a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290a0cc5-0275-4a89-9249-6fa0a92b34a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e8380a0-0787-4a5a-bf96-025ba41f6a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:30 devstack sudo[87986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-05d26d47-13a3-4ab5-ae66-9f3194943f8c Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e8380a0-0787-4a5a-bf96-025ba41f6a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9de99f4-09ea-42a2-a90b-091add649720', 'volume_name': 'volume-e9de99f4-09ea-42a2-a90b-091add649720', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:30 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757b95cc-8a30-4d6b-9425-170a197e665b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757b95cc-8a30-4d6b-9425-170a197e665b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a4b1e2a-885b-44dd-b30b-dcb50816c306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:30 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Volume e9de99f4-09ea-42a2-a90b-091add649720: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9de99f4-09ea-42a2-a90b-091add649720', 'volume_size': 1} Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1457620668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9de99f4-09ea-42a2-a90b-091add649720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='655c8c0f922e44f3b9ad9120a1db37bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:30Z,use_quota=True,user_id='d8bd1aefa8014a9c8f4d8be50a476d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Creating volume e9de99f4-09ea-42a2-a90b-091add649720 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:30 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:30 devstack sudo[87991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720 1073741824 Feb 27 12:32:30 devstack sudo[87991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:30 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc0f53f9-7fcc-4840-9766-fe35fc08913a tempest-CreateVolumesFromImageTest-730118429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-05d26d47-13a3-4ab5-ae66-9f3194943f8c" returned: 0 in 0.660s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc0f53f9-7fcc-4840-9766-fe35fc08913a tempest-CreateVolumesFromImageTest-730118429 None] Lock "cinder-quobyte-05d26d47-13a3-4ab5-ae66-9f3194943f8c" released by "delete_volume" :: held 2.006s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-bc0f53f9-7fcc-4840-9766-fe35fc08913a tempest-CreateVolumesFromImageTest-730118429 None] Created reservations ['85afe009-abf7-467d-a11d-09079c5dd86b', '2d105f25-f390-4a6f-a684-b468c378b7ea', '719af9f8-393a-47b4-bb39-c336acec478d', 'fad90f19-2e7d-4736-a8cb-977670e39f13'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bc0f53f9-7fcc-4840-9766-fe35fc08913a tempest-CreateVolumesFromImageTest-730118429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bc0f53f9-7fcc-4840-9766-fe35fc08913a tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bc0f53f9-7fcc-4840-9766-fe35fc08913a tempest-CreateVolumesFromImageTest-730118429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bc0f53f9-7fcc-4840-9766-fe35fc08913a tempest-CreateVolumesFromImageTest-730118429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bc0f53f9-7fcc-4840-9766-fe35fc08913a tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc0f53f9-7fcc-4840-9766-fe35fc08913a tempest-CreateVolumesFromImageTest-730118429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:30 devstack sudo[88005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:32:30 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f34d8f4f-d068-41c2-898f-97fb67afa517 tempest-CreateVolumesFromImageTest-730118429 None] Acquiring lock "cinder-2c20e249-1349-4523-be89-709e20f33085-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f34d8f4f-d068-41c2-898f-97fb67afa517 tempest-CreateVolumesFromImageTest-730118429 None] Lock "cinder-2c20e249-1349-4523-be89-709e20f33085-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:31 devstack sudo[87991]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720 1073741824" returned: 0 in 0.950s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f34d8f4f-d068-41c2-898f-97fb67afa517 tempest-CreateVolumesFromImageTest-730118429 None] Acquiring lock "cinder-quobyte-2c20e249-1349-4523-be89-709e20f33085" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f34d8f4f-d068-41c2-898f-97fb67afa517 tempest-CreateVolumesFromImageTest-730118429 None] Lock "cinder-quobyte-2c20e249-1349-4523-be89-709e20f33085" acquired by "delete_volume" :: waited 0.033s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff54e825-ea1f-4ddc-afaf-751eec7a565d]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f34d8f4f-d068-41c2-898f-97fb67afa517 tempest-CreateVolumesFromImageTest-730118429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2c20e249-1349-4523-be89-709e20f33085 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:31 devstack sudo[88009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720 Feb 27 12:32:31 devstack sudo[88009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:31 devstack sudo[88010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2c20e249-1349-4523-be89-709e20f33085 Feb 27 12:32:31 devstack sudo[88010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:31 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Flow 'volume_create_manager' (a483f8cd-3411-4a0b-a010-2bcc3501d70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf2ac0e3-6283-447f-b711-f7ac5134deed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc0f53f9-7fcc-4840-9766-fe35fc08913a tempest-CreateVolumesFromImageTest-730118429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.746s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-bc0f53f9-7fcc-4840-9766-fe35fc08913a tempest-CreateVolumesFromImageTest-730118429 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:31 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-bc0f53f9-7fcc-4840-9766-fe35fc08913a tempest-CreateVolumesFromImageTest-730118429 None] Deleted volume successfully. Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf2ac0e3-6283-447f-b711-f7ac5134deed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1524712495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df94df70-8193-424e-938c-8ed9ba2eea0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bbb9c48c5994e6abcb3dd6162a2e570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:31Z,use_quota=True,user_id='4e2d208287834932bacc02ee314a8619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b4b7ddb-f117-4d7e-91bd-4b32d532967e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b4b7ddb-f117-4d7e-91bd-4b32d532967e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1fae7e-e474-4d25-a03f-44f51e036572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1fae7e-e474-4d25-a03f-44f51e036572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df94df70-8193-424e-938c-8ed9ba2eea0b', 'volume_name': 'volume-df94df70-8193-424e-938c-8ed9ba2eea0b', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f29453b5-1c2c-4861-8a7d-d82cd208d2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f29453b5-1c2c-4861-8a7d-d82cd208d2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed08beed-1d3c-4b6f-8e65-206ac20e67e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:31 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Volume df94df70-8193-424e-938c-8ed9ba2eea0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df94df70-8193-424e-938c-8ed9ba2eea0b', 'volume_size': 1} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc0f53f9-7fcc-4840-9766-fe35fc08913a tempest-CreateVolumesFromImageTest-730118429 None] Lock "cinder-05d26d47-13a3-4ab5-ae66-9f3194943f8c-delete_volume" released by "delete_volume" :: held 2.962s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:31 devstack sudo[88009]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720" returned: 0 in 0.696s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.236s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1524712495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df94df70-8193-424e-938c-8ed9ba2eea0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bbb9c48c5994e6abcb3dd6162a2e570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:31Z,use_quota=True,user_id='4e2d208287834932bacc02ee314a8619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Creating volume df94df70-8193-424e-938c-8ed9ba2eea0b {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:31 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-df94df70-8193-424e-938c-8ed9ba2eea0b 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a4b1e2a-885b-44dd-b30b-dcb50816c306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9de99f4-09ea-42a2-a90b-091add649720', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (593e269c-c8dd-49ac-9d8b-28e6508fed72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:31 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Volume volume-e9de99f4-09ea-42a2-a90b-091add649720 (e9de99f4-09ea-42a2-a90b-091add649720): created successfully Feb 27 12:32:31 devstack sudo[88015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-df94df70-8193-424e-938c-8ed9ba2eea0b 1073741824 Feb 27 12:32:31 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (593e269c-c8dd-49ac-9d8b-28e6508fed72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:31 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Flow 'volume_create_manager' (3a1b96fe-b1f6-4118-8506-89eaa044e4b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:31 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-f56d47bc-695c-4bf2-a605-51a5c749de4b tempest-VolumesGetTest-1017574975 None] Created volume successfully. Feb 27 12:32:32 devstack sudo[88010]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f34d8f4f-d068-41c2-898f-97fb67afa517 tempest-CreateVolumesFromImageTest-730118429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2c20e249-1349-4523-be89-709e20f33085" returned: 0 in 0.864s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f34d8f4f-d068-41c2-898f-97fb67afa517 tempest-CreateVolumesFromImageTest-730118429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2c20e249-1349-4523-be89-709e20f33085 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:32 devstack sudo[88020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2c20e249-1349-4523-be89-709e20f33085 Feb 27 12:32:32 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:32 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:32 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-df94df70-8193-424e-938c-8ed9ba2eea0b 1073741824" returned: 0 in 0.752s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:32 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Flow 'volume_create_manager' (affe4ced-9133-417e-835e-157ae937ab74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (377b42c9-ac3f-41e2-95a1-bd4df3e64e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f34d8f4f-d068-41c2-898f-97fb67afa517 tempest-CreateVolumesFromImageTest-730118429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2c20e249-1349-4523-be89-709e20f33085" returned: 0 in 0.615s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (377b42c9-ac3f-41e2-95a1-bd4df3e64e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-864554374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62643c77-a1d3-4448-a5ad-550ec496411b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='655c8c0f922e44f3b9ad9120a1db37bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e9de99f4-09ea-42a2-a90b-091add649720,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:33Z,use_quota=True,user_id='d8bd1aefa8014a9c8f4d8be50a476d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (645654e2-45f9-4ad7-b315-60073a66e912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (645654e2-45f9-4ad7-b315-60073a66e912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9072485e-57bb-4c3a-a150-e4d546f46c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:32 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f34d8f4f-d068-41c2-898f-97fb67afa517 tempest-CreateVolumesFromImageTest-730118429 None] Lock "cinder-quobyte-2c20e249-1349-4523-be89-709e20f33085" released by "delete_volume" :: held 1.559s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9072485e-57bb-4c3a-a150-e4d546f46c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '62643c77-a1d3-4448-a5ad-550ec496411b', 'volume_name': 'volume-62643c77-a1d3-4448-a5ad-550ec496411b', 'volume_size': 1, 'source_volid': 'e9de99f4-09ea-42a2-a90b-091add649720', 'source_volstatus': 'available'}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9f5d60-9942-42fd-b309-236a75dfd100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9f5d60-9942-42fd-b309-236a75dfd100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b52ce8ea-770a-4efb-8968-e7e2519b9bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:32 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Volume 62643c77-a1d3-4448-a5ad-550ec496411b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-62643c77-a1d3-4448-a5ad-550ec496411b', 'volume_size': 1, 'source_volid': 'e9de99f4-09ea-42a2-a90b-091add649720', 'source_volstatus': 'available'} Feb 27 12:32:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-df94df70-8193-424e-938c-8ed9ba2eea0b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:32 devstack sudo[88027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-df94df70-8193-424e-938c-8ed9ba2eea0b Feb 27 12:32:32 devstack sudo[88027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:32 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-f34d8f4f-d068-41c2-898f-97fb67afa517 tempest-CreateVolumesFromImageTest-730118429 None] Created reservations ['aba778b1-f335-4684-9afa-886e97f6ade9', 'ade8a95e-95eb-43ce-822a-575f8a3f3071', 'a376e71c-3fb0-4fdb-a0d3-8b8d5aee39dd', '8fb5506c-25b8-4d9e-ba83-cb7104027c54'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f34d8f4f-d068-41c2-898f-97fb67afa517 tempest-CreateVolumesFromImageTest-730118429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f34d8f4f-d068-41c2-898f-97fb67afa517 tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:32 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f34d8f4f-d068-41c2-898f-97fb67afa517 tempest-CreateVolumesFromImageTest-730118429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:32 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f34d8f4f-d068-41c2-898f-97fb67afa517 tempest-CreateVolumesFromImageTest-730118429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f34d8f4f-d068-41c2-898f-97fb67afa517 tempest-CreateVolumesFromImageTest-730118429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f34d8f4f-d068-41c2-898f-97fb67afa517 tempest-CreateVolumesFromImageTest-730118429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:32 devstack sudo[88029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:32:32 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:33 devstack sudo[88027]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-df94df70-8193-424e-938c-8ed9ba2eea0b" returned: 0 in 0.538s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:33 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:32:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.515s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:33 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Cloning volume e9de99f4-09ea-42a2-a90b-091add649720 to volume 62643c77-a1d3-4448-a5ad-550ec496411b Feb 27 12:32:33 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed08beed-1d3c-4b6f-8e65-206ac20e67e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df94df70-8193-424e-938c-8ed9ba2eea0b', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:33 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e410e520-7fb5-497f-90d6-8e8afc375735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:33 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Volume volume-df94df70-8193-424e-938c-8ed9ba2eea0b (df94df70-8193-424e-938c-8ed9ba2eea0b): created successfully Feb 27 12:32:33 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e410e520-7fb5-497f-90d6-8e8afc375735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:33 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Flow 'volume_create_manager' (a483f8cd-3411-4a0b-a010-2bcc3501d70a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:33 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-01bc2eb5-5d24-4a8e-ba15-d67e60ba0418 tempest-VolumesActionsTest-1685731934 None] Created volume successfully. Feb 27 12:32:33 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Creating offline snapshot 54407d2d-63d5-4639-855a-0977655dab05 of volume e9de99f4-09ea-42a2-a90b-091add649720 {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:32:33 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d22c61-1f28-428f-96b3-332b7709f9fc]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:33 devstack sudo[88034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720 Feb 27 12:32:33 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:33 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f34d8f4f-d068-41c2-898f-97fb67afa517 tempest-CreateVolumesFromImageTest-730118429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.692s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:33 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-f34d8f4f-d068-41c2-898f-97fb67afa517 tempest-CreateVolumesFromImageTest-730118429 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:33 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-f34d8f4f-d068-41c2-898f-97fb67afa517 tempest-CreateVolumesFromImageTest-730118429 None] Deleted volume successfully. Feb 27 12:32:33 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f34d8f4f-d068-41c2-898f-97fb67afa517 tempest-CreateVolumesFromImageTest-730118429 None] Lock "cinder-2c20e249-1349-4523-be89-709e20f33085-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:33 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-66544c51-ac07-450d-9031-46872ca7190e tempest-VolumesActionsTest-1685731934 None] Acquiring lock "cinder-df94df70-8193-424e-938c-8ed9ba2eea0b" by "attach_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:33 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-66544c51-ac07-450d-9031-46872ca7190e tempest-VolumesActionsTest-1685731934 None] Lock "cinder-df94df70-8193-424e-938c-8ed9ba2eea0b" acquired by "attach_volume" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:33 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-66544c51-ac07-450d-9031-46872ca7190e tempest-VolumesActionsTest-1685731934 None] Attaching volume df94df70-8193-424e-938c-8ed9ba2eea0b to instance fe183753-e377-4f23-a752-c999db7643da at mountpoint /dev/vdb on host None. Feb 27 12:32:33 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-66544c51-ac07-450d-9031-46872ca7190e tempest-VolumesActionsTest-1685731934 None] Attach volume completed successfully. Feb 27 12:32:33 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-66544c51-ac07-450d-9031-46872ca7190e tempest-VolumesActionsTest-1685731934 None] Lock "cinder-df94df70-8193-424e-938c-8ed9ba2eea0b" released by "attach_volume" :: held 0.081s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:34 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720" returned: 0 in 0.760s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.54407d2d-63d5-4639-855a-0977655dab05 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:34 devstack sudo[88039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.54407d2d-63d5-4639-855a-0977655dab05 1G Feb 27 12:32:34 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:34 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-02aa18f9-dd64-4f17-a924-d3f108c7113e tempest-VolumesActionsTest-1768883894 None] Terminate volume connection completed successfully. Feb 27 12:32:35 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.54407d2d-63d5-4639-855a-0977655dab05 1G" returned: 0 in 0.847s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9de99f4-09ea-42a2-a90b-091add649720 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.54407d2d-63d5-4639-855a-0977655dab05 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:35 devstack sudo[88047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9de99f4-09ea-42a2-a90b-091add649720 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.54407d2d-63d5-4639-855a-0977655dab05 Feb 27 12:32:35 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:35 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-02aa18f9-dd64-4f17-a924-d3f108c7113e tempest-VolumesActionsTest-1768883894 None] Acquiring lock "cinder-df94df70-8193-424e-938c-8ed9ba2eea0b-detach_volume" by "detach_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:35 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-02aa18f9-dd64-4f17-a924-d3f108c7113e tempest-VolumesActionsTest-1768883894 None] Lock "cinder-df94df70-8193-424e-938c-8ed9ba2eea0b-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:35 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-02aa18f9-dd64-4f17-a924-d3f108c7113e tempest-VolumesActionsTest-1768883894 None] Detaching volume df94df70-8193-424e-938c-8ed9ba2eea0b from instance fe183753-e377-4f23-a752-c999db7643da. Feb 27 12:32:35 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-02aa18f9-dd64-4f17-a924-d3f108c7113e tempest-VolumesActionsTest-1768883894 None] Detach volume completed successfully. Feb 27 12:32:35 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-02aa18f9-dd64-4f17-a924-d3f108c7113e tempest-VolumesActionsTest-1768883894 None] Lock "cinder-df94df70-8193-424e-938c-8ed9ba2eea0b-detach_volume" released by "detach_volume" :: held 0.064s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:35 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9de99f4-09ea-42a2-a90b-091add649720 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.54407d2d-63d5-4639-855a-0977655dab05" returned: 0 in 0.423s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:35 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.54407d2d-63d5-4639-855a-0977655dab05 is being set with open permissions: ugo+rw Feb 27 12:32:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.54407d2d-63d5-4639-855a-0977655dab05 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:35 devstack sudo[88052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.54407d2d-63d5-4639-855a-0977655dab05 Feb 27 12:32:35 devstack sudo[88052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:35 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Flow 'volume_create_manager' (b4e209a9-f6fe-4f29-b530-04ac04d44e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc55f11c-4b63-403c-8dbd-c37af1395302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc55f11c-4b63-403c-8dbd-c37af1395302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-812916759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8640575c-1ec1-4b4b-920b-a27d381bae1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58b02d247ec34f9a8572656664154212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:35Z,use_quota=True,user_id='61d8c408bf714321b863f937cf793d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3819e05-6e0a-4d37-a35d-1a5eef6f026e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3819e05-6e0a-4d37-a35d-1a5eef6f026e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f32f7897-0553-486d-a8c4-a4b7278d4c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f32f7897-0553-486d-a8c4-a4b7278d4c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8640575c-1ec1-4b4b-920b-a27d381bae1d', 'volume_name': 'volume-8640575c-1ec1-4b4b-920b-a27d381bae1d', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c822cbf8-05d5-44d6-9670-602dc824a162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c822cbf8-05d5-44d6-9670-602dc824a162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a11630-d570-4e59-8bff-89af7d8af3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:35 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Volume 8640575c-1ec1-4b4b-920b-a27d381bae1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8640575c-1ec1-4b4b-920b-a27d381bae1d', 'volume_size': 1} Feb 27 12:32:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:35 devstack sudo[88052]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.54407d2d-63d5-4639-855a-0977655dab05" returned: 0 in 0.426s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:35 devstack sudo[88055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.info Feb 27 12:32:35 devstack sudo[88055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:35 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5fca09b6-f45d-4050-8b83-ce9aaf6ca1f9 tempest-VolumesActionsTest-1685731934 None] Acquiring lock "cinder-df94df70-8193-424e-938c-8ed9ba2eea0b-detach_volume" by "detach_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:35 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5fca09b6-f45d-4050-8b83-ce9aaf6ca1f9 tempest-VolumesActionsTest-1685731934 None] Lock "cinder-df94df70-8193-424e-938c-8ed9ba2eea0b-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:35 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-5fca09b6-f45d-4050-8b83-ce9aaf6ca1f9 tempest-VolumesActionsTest-1685731934 None] Volume detach called, but volume not attached. Feb 27 12:32:35 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5fca09b6-f45d-4050-8b83-ce9aaf6ca1f9 tempest-VolumesActionsTest-1685731934 None] Lock "cinder-df94df70-8193-424e-938c-8ed9ba2eea0b-detach_volume" released by "detach_volume" :: held 0.019s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:36 devstack sudo[88055]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.info" returned: 0 in 0.661s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:36 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.info is being set with open permissions: ugo+rw Feb 27 12:32:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:36 devstack sudo[88084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.info Feb 27 12:32:36 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-972374c4-2884-4a3b-8872-ee6b55367788 tempest-VolumesActionsTest-1685731934 None] Acquiring lock "cinder-df94df70-8193-424e-938c-8ed9ba2eea0b-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-972374c4-2884-4a3b-8872-ee6b55367788 tempest-VolumesActionsTest-1685731934 None] Lock "cinder-df94df70-8193-424e-938c-8ed9ba2eea0b-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-972374c4-2884-4a3b-8872-ee6b55367788 tempest-VolumesActionsTest-1685731934 None] Acquiring lock "cinder-quobyte-df94df70-8193-424e-938c-8ed9ba2eea0b" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-972374c4-2884-4a3b-8872-ee6b55367788 tempest-VolumesActionsTest-1685731934 None] Lock "cinder-quobyte-df94df70-8193-424e-938c-8ed9ba2eea0b" acquired by "delete_volume" :: waited 0.023s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:36 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b1a09e-92e5-4b28-9f5b-aacb9b3d4750]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-972374c4-2884-4a3b-8872-ee6b55367788 tempest-VolumesActionsTest-1685731934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-df94df70-8193-424e-938c-8ed9ba2eea0b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:37 devstack sudo[88087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-df94df70-8193-424e-938c-8ed9ba2eea0b Feb 27 12:32:37 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:37 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.info" returned: 0 in 0.563s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:37 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Acquiring lock "cinder-quobyte-62643c77-a1d3-4448-a5ad-550ec496411b" by "_copy_volume_from_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:37 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Lock "cinder-quobyte-62643c77-a1d3-4448-a5ad-550ec496411b" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:37 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] snapshot: 54407d2d-63d5-4639-855a-0977655dab05, volume: 62643c77-a1d3-4448-a5ad-550ec496411b, {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 12:32:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:37 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:37 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:37 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[b405ebb9-2b8b-4f7d-a265-60a5eac4782f]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.54407d2d-63d5-4639-855a-0977655dab05 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:37 devstack sudo[88090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.54407d2d-63d5-4639-855a-0977655dab05 Feb 27 12:32:37 devstack sudo[88090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:37 devstack sudo[88090]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.54407d2d-63d5-4639-855a-0977655dab05" returned: 0 in 0.589s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:37 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9de99f4-09ea-42a2-a90b-091add649720(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:32:37 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720 {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 12:32:37 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Creating direct copy from snapshot {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 12:32:37 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa1399a-f22e-4525-936d-a2910375b900]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:37 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-972374c4-2884-4a3b-8872-ee6b55367788 tempest-VolumesActionsTest-1685731934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-df94df70-8193-424e-938c-8ed9ba2eea0b" returned: 0 in 0.860s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-972374c4-2884-4a3b-8872-ee6b55367788 tempest-VolumesActionsTest-1685731934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-df94df70-8193-424e-938c-8ed9ba2eea0b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:37 devstack sudo[88099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-df94df70-8193-424e-938c-8ed9ba2eea0b Feb 27 12:32:37 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:37 devstack sudo[88098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720 Feb 27 12:32:38 devstack sudo[88098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:38 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-972374c4-2884-4a3b-8872-ee6b55367788 tempest-VolumesActionsTest-1685731934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-df94df70-8193-424e-938c-8ed9ba2eea0b" returned: 0 in 0.537s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:38 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-972374c4-2884-4a3b-8872-ee6b55367788 tempest-VolumesActionsTest-1685731934 None] Lock "cinder-quobyte-df94df70-8193-424e-938c-8ed9ba2eea0b" released by "delete_volume" :: held 1.474s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:38 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-972374c4-2884-4a3b-8872-ee6b55367788 tempest-VolumesActionsTest-1685731934 None] Created reservations ['bb4398b8-2146-4afa-b589-74a15497554c', 'ee1f494c-fe15-43f7-abd4-d616c8bda624', '35f8eb44-eb63-465e-8f84-dde8eb02b64e', '5f3970a8-d66d-42ad-bfc9-c1b01301efbe'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-972374c4-2884-4a3b-8872-ee6b55367788 tempest-VolumesActionsTest-1685731934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-972374c4-2884-4a3b-8872-ee6b55367788 tempest-VolumesActionsTest-1685731934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:38 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-972374c4-2884-4a3b-8872-ee6b55367788 tempest-VolumesActionsTest-1685731934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:38 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-972374c4-2884-4a3b-8872-ee6b55367788 tempest-VolumesActionsTest-1685731934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-972374c4-2884-4a3b-8872-ee6b55367788 tempest-VolumesActionsTest-1685731934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-972374c4-2884-4a3b-8872-ee6b55367788 tempest-VolumesActionsTest-1685731934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:38 devstack sudo[88105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:32:38 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:38 devstack sudo[88098]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720" returned: 0 in 0.927s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:38 devstack cinder-volume[83077]: DEBUG cinder.utils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Path /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-62643c77-a1d3-4448-a5ad-550ec496411b not found in is_blk_device check {{(pid=83077) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 12:32:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-62643c77-a1d3-4448-a5ad-550ec496411b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:38 devstack sudo[88108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-62643c77-a1d3-4448-a5ad-550ec496411b Feb 27 12:32:38 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:39 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-972374c4-2884-4a3b-8872-ee6b55367788 tempest-VolumesActionsTest-1685731934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.810s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:39 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-972374c4-2884-4a3b-8872-ee6b55367788 tempest-VolumesActionsTest-1685731934 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:39 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-972374c4-2884-4a3b-8872-ee6b55367788 tempest-VolumesActionsTest-1685731934 None] Deleted volume successfully. Feb 27 12:32:39 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-972374c4-2884-4a3b-8872-ee6b55367788 tempest-VolumesActionsTest-1685731934 None] Lock "cinder-df94df70-8193-424e-938c-8ed9ba2eea0b-delete_volume" released by "delete_volume" :: held 2.567s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:42 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-62643c77-a1d3-4448-a5ad-550ec496411b" returned: 0 in 3.530s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:42 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[059be7c3-80c0-40e6-830c-b3a0b6fa54e7]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:42 devstack sudo[88150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720 Feb 27 12:32:42 devstack sudo[88150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:42 devstack sudo[88150]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720" returned: 0 in 0.684s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:42 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Image conversion details: src /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720, size 1024.00 MB, duration 3.53 sec, destination /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-62643c77-a1d3-4448-a5ad-550ec496411b {{(pid=83077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:32:42 devstack cinder-volume[83077]: INFO cinder.image.image_utils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Converted 1024.00 MB image at 290.06 MB/s Feb 27 12:32:42 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-62643c77-a1d3-4448-a5ad-550ec496411b is being set with open permissions: ugo+rw Feb 27 12:32:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-62643c77-a1d3-4448-a5ad-550ec496411b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:42 devstack sudo[88156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-62643c77-a1d3-4448-a5ad-550ec496411b Feb 27 12:32:42 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:43 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-62643c77-a1d3-4448-a5ad-550ec496411b" returned: 0 in 0.418s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:43 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Lock "cinder-quobyte-62643c77-a1d3-4448-a5ad-550ec496411b" released by "_copy_volume_from_snapshot" :: held 6.231s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:43 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Acquiring lock "cinder-quobyte-54407d2d-63d5-4639-855a-0977655dab05" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:43 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Lock "cinder-quobyte-54407d2d-63d5-4639-855a-0977655dab05" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:43 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Deleting offline snapshot 54407d2d-63d5-4639-855a-0977655dab05 of volume e9de99f4-09ea-42a2-a90b-091add649720 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:32:43 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] snapshot_file for this snap is: volume-e9de99f4-09ea-42a2-a90b-091add649720.54407d2d-63d5-4639-855a-0977655dab05 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:32:43 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f05c18-03c5-4990-801f-8f92db823a2a]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.54407d2d-63d5-4639-855a-0977655dab05 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:43 devstack sudo[88159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.54407d2d-63d5-4639-855a-0977655dab05 Feb 27 12:32:43 devstack sudo[88159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:43 devstack sudo[88159]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.54407d2d-63d5-4639-855a-0977655dab05" returned: 0 in 0.518s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:43 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9de99f4-09ea-42a2-a90b-091add649720(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:32:43 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[795a3fe4-a2f9-42fa-aa29-e41873f44306]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:44 devstack sudo[88164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720 Feb 27 12:32:44 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:44 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720" returned: 0 in 0.532s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.54407d2d-63d5-4639-855a-0977655dab05 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:44 devstack sudo[88169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.54407d2d-63d5-4639-855a-0977655dab05 Feb 27 12:32:44 devstack sudo[88169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:45 devstack sudo[88169]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.54407d2d-63d5-4639-855a-0977655dab05" returned: 0 in 0.548s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.54407d2d-63d5-4639-855a-0977655dab05 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:45 devstack sudo[88174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.54407d2d-63d5-4639-855a-0977655dab05 Feb 27 12:32:45 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:45 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720.54407d2d-63d5-4639-855a-0977655dab05" returned: 0 in 0.417s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:45 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Lock "cinder-quobyte-54407d2d-63d5-4639-855a-0977655dab05" released by "_delete_snapshot" :: held 2.078s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.182s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.915s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:45 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-812916759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8640575c-1ec1-4b4b-920b-a27d381bae1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58b02d247ec34f9a8572656664154212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:35Z,use_quota=True,user_id='61d8c408bf714321b863f937cf793d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:45 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Creating volume 8640575c-1ec1-4b4b-920b-a27d381bae1d {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:45 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:45 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:45 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:45 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:32:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b52ce8ea-770a-4efb-8968-e7e2519b9bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62643c77-a1d3-4448-a5ad-550ec496411b', 'volume_size': 1, 'source_volid': 'e9de99f4-09ea-42a2-a90b-091add649720', 'source_volstatus': 'available'}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4255bf23-bc41-46b2-a358-2d6883da135f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:45 devstack sudo[88177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d 1073741824 Feb 27 12:32:45 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:45 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Volume volume-62643c77-a1d3-4448-a5ad-550ec496411b (62643c77-a1d3-4448-a5ad-550ec496411b): created successfully Feb 27 12:32:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4255bf23-bc41-46b2-a358-2d6883da135f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Flow 'volume_create_manager' (affe4ced-9133-417e-835e-157ae937ab74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:45 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-ad36a126-8f0f-4009-8faa-e81b3fadcde9 tempest-VolumesGetTest-1017574975 None] Created volume successfully. Feb 27 12:32:46 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d 1073741824" returned: 0 in 0.699s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:46 devstack sudo[88182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d Feb 27 12:32:46 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Flow 'volume_create_manager' (503fcb25-1f03-4157-848f-e3d5594adcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89de450a-6518-413f-a3bc-55295bbb7660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89de450a-6518-413f-a3bc-55295bbb7660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-768310059',display_name='tempest-VolumesGetTest-Volume-1207781275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31bc5baa-8050-46fb-96b7-4af92e44e2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='655c8c0f922e44f3b9ad9120a1db37bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:46Z,use_quota=True,user_id='d8bd1aefa8014a9c8f4d8be50a476d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222466e9-53d0-4020-a419-806bcbdc13aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222466e9-53d0-4020-a419-806bcbdc13aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a73572-794a-4566-8b50-30575b590154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a73572-794a-4566-8b50-30575b590154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31bc5baa-8050-46fb-96b7-4af92e44e2a2', 'volume_name': 'volume-31bc5baa-8050-46fb-96b7-4af92e44e2a2', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c45bf6-3c4c-48cc-95b3-4800a6296fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c45bf6-3c4c-48cc-95b3-4800a6296fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79fbfd0a-ac20-45aa-94f6-65a47b62f76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:46 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Volume 31bc5baa-8050-46fb-96b7-4af92e44e2a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31bc5baa-8050-46fb-96b7-4af92e44e2a2', 'volume_size': 1} Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:46 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d" returned: 0 in 0.592s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.341s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-768310059',display_name='tempest-VolumesGetTest-Volume-1207781275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31bc5baa-8050-46fb-96b7-4af92e44e2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='655c8c0f922e44f3b9ad9120a1db37bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:46Z,use_quota=True,user_id='d8bd1aefa8014a9c8f4d8be50a476d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Creating volume 31bc5baa-8050-46fb-96b7-4af92e44e2a2 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:46 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-31bc5baa-8050-46fb-96b7-4af92e44e2a2 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a11630-d570-4e59-8bff-89af7d8af3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8640575c-1ec1-4b4b-920b-a27d381bae1d', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (284e8701-e1b5-423a-bd79-89eeca447240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:46 devstack sudo[88185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-31bc5baa-8050-46fb-96b7-4af92e44e2a2 1073741824 Feb 27 12:32:46 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:46 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Volume volume-8640575c-1ec1-4b4b-920b-a27d381bae1d (8640575c-1ec1-4b4b-920b-a27d381bae1d): created successfully Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (284e8701-e1b5-423a-bd79-89eeca447240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Flow 'volume_create_manager' (b4e209a9-f6fe-4f29-b530-04ac04d44e44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:46 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-0ebac3eb-d284-47af-a04c-a3db0766e072 tempest-CreateVolumesFromSnapshotTest-84566612 None] Created volume successfully. Feb 27 12:32:47 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-31bc5baa-8050-46fb-96b7-4af92e44e2a2 1073741824" returned: 0 in 0.754s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-31bc5baa-8050-46fb-96b7-4af92e44e2a2 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:47 devstack sudo[88190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-31bc5baa-8050-46fb-96b7-4af92e44e2a2 Feb 27 12:32:47 devstack sudo[88190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:47 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Flow 'volume_create_manager' (5f414e2f-ced9-49af-9c0f-217e49f0d1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7198ee90-4092-4d7a-91f1-acb3fe14293a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7198ee90-4092-4d7a-91f1-acb3fe14293a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1029462960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc7d9fe6-900f-4827-9a11-3d9fba99a5c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bbb9c48c5994e6abcb3dd6162a2e570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:48Z,use_quota=True,user_id='4e2d208287834932bacc02ee314a8619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2e92ecc-9849-41a5-990e-4236058d45ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2e92ecc-9849-41a5-990e-4236058d45ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd3f309-0aef-43d0-904a-fbf83ef6445f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd3f309-0aef-43d0-904a-fbf83ef6445f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc7d9fe6-900f-4827-9a11-3d9fba99a5c0', 'volume_name': 'volume-bc7d9fe6-900f-4827-9a11-3d9fba99a5c0', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e7d5770-959f-48dd-a6b5-e5da9284e870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e7d5770-959f-48dd-a6b5-e5da9284e870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:47 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a0bbd5b-43c7-43c0-88f3-efe70361df1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:47 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Volume bc7d9fe6-900f-4827-9a11-3d9fba99a5c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc7d9fe6-900f-4827-9a11-3d9fba99a5c0', 'volume_size': 1} Feb 27 12:32:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-307d9f5d-6b47-43e2-9af7-f7151aff80ad tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:48 devstack sudo[88190]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-31bc5baa-8050-46fb-96b7-4af92e44e2a2" returned: 0 in 0.585s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:48 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:32:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.421s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:48 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1029462960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc7d9fe6-900f-4827-9a11-3d9fba99a5c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bbb9c48c5994e6abcb3dd6162a2e570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:48Z,use_quota=True,user_id='4e2d208287834932bacc02ee314a8619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:48 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Creating volume bc7d9fe6-900f-4827-9a11-3d9fba99a5c0 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:48 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:48 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:48 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:48 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:32:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-bc7d9fe6-900f-4827-9a11-3d9fba99a5c0 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:48 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79fbfd0a-ac20-45aa-94f6-65a47b62f76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31bc5baa-8050-46fb-96b7-4af92e44e2a2', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:48 devstack sudo[88204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-bc7d9fe6-900f-4827-9a11-3d9fba99a5c0 1073741824 Feb 27 12:32:48 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:48 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6b4a01-cb2c-462b-b16b-eba101600564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:48 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Volume volume-31bc5baa-8050-46fb-96b7-4af92e44e2a2 (31bc5baa-8050-46fb-96b7-4af92e44e2a2): created successfully Feb 27 12:32:48 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6b4a01-cb2c-462b-b16b-eba101600564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:48 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Flow 'volume_create_manager' (503fcb25-1f03-4157-848f-e3d5594adcda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:48 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-6fdff7f4-bf97-417e-b6ed-44bb20f39f08 tempest-VolumesGetTest-1017574975 None] Created volume successfully. Feb 27 12:32:48 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc508860-c678-4df5-9d91-ac8526d297db tempest-VolumesGetTest-1017574975 None] Acquiring lock "cinder-31bc5baa-8050-46fb-96b7-4af92e44e2a2-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:48 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc508860-c678-4df5-9d91-ac8526d297db tempest-VolumesGetTest-1017574975 None] Lock "cinder-31bc5baa-8050-46fb-96b7-4af92e44e2a2-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:48 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc508860-c678-4df5-9d91-ac8526d297db tempest-VolumesGetTest-1017574975 None] Acquiring lock "cinder-quobyte-31bc5baa-8050-46fb-96b7-4af92e44e2a2" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:48 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc508860-c678-4df5-9d91-ac8526d297db tempest-VolumesGetTest-1017574975 None] Lock "cinder-quobyte-31bc5baa-8050-46fb-96b7-4af92e44e2a2" acquired by "delete_volume" :: waited 0.014s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:48 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[712d3cad-fa8f-461e-8711-f7f1872ea760]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc508860-c678-4df5-9d91-ac8526d297db tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-31bc5baa-8050-46fb-96b7-4af92e44e2a2 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:48 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-bc7d9fe6-900f-4827-9a11-3d9fba99a5c0 1073741824" returned: 0 in 0.660s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:48 devstack sudo[88214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-31bc5baa-8050-46fb-96b7-4af92e44e2a2 Feb 27 12:32:48 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-bc7d9fe6-900f-4827-9a11-3d9fba99a5c0 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:48 devstack sudo[88216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-bc7d9fe6-900f-4827-9a11-3d9fba99a5c0 Feb 27 12:32:48 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:49 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc508860-c678-4df5-9d91-ac8526d297db tempest-VolumesGetTest-1017574975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-31bc5baa-8050-46fb-96b7-4af92e44e2a2" returned: 0 in 0.476s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc508860-c678-4df5-9d91-ac8526d297db tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-31bc5baa-8050-46fb-96b7-4af92e44e2a2 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:49 devstack sudo[88222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-31bc5baa-8050-46fb-96b7-4af92e44e2a2 Feb 27 12:32:49 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:49 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-bc7d9fe6-900f-4827-9a11-3d9fba99a5c0" returned: 0 in 0.464s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-307d9f5d-6b47-43e2-9af7-f7151aff80ad tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.364s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a0bbd5b-43c7-43c0-88f3-efe70361df1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc7d9fe6-900f-4827-9a11-3d9fba99a5c0', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0a6904-9ed9-4160-b1d6-4c483edf5541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-307d9f5d-6b47-43e2-9af7-f7151aff80ad tempest-CreateVolumesFromSnapshotTest-84566612 None] Creating offline snapshot 8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9 of volume 8640575c-1ec1-4b4b-920b-a27d381bae1d {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8d2255-3386-4243-8255-ad0c7a229a52]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-307d9f5d-6b47-43e2-9af7-f7151aff80ad tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:49 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Volume volume-bc7d9fe6-900f-4827-9a11-3d9fba99a5c0 (bc7d9fe6-900f-4827-9a11-3d9fba99a5c0): created successfully Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0a6904-9ed9-4160-b1d6-4c483edf5541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Flow 'volume_create_manager' (5f414e2f-ced9-49af-9c0f-217e49f0d1d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:49 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-cfc27563-12b9-486d-b179-1cef61f00616 tempest-VolumesActionsTest-1685731934 None] Created volume successfully. Feb 27 12:32:49 devstack sudo[88224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d Feb 27 12:32:49 devstack sudo[88224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d30f2c45-7e0f-4aa7-95f3-c7d248cc93c9 tempest-VolumesActionsTest-1768883894 None] Acquiring lock "cinder-bc7d9fe6-900f-4827-9a11-3d9fba99a5c0-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d30f2c45-7e0f-4aa7-95f3-c7d248cc93c9 tempest-VolumesActionsTest-1768883894 None] Lock "cinder-bc7d9fe6-900f-4827-9a11-3d9fba99a5c0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:49 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc508860-c678-4df5-9d91-ac8526d297db tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-31bc5baa-8050-46fb-96b7-4af92e44e2a2" returned: 0 in 0.512s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc508860-c678-4df5-9d91-ac8526d297db tempest-VolumesGetTest-1017574975 None] Lock "cinder-quobyte-31bc5baa-8050-46fb-96b7-4af92e44e2a2" released by "delete_volume" :: held 1.019s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d30f2c45-7e0f-4aa7-95f3-c7d248cc93c9 tempest-VolumesActionsTest-1768883894 None] Acquiring lock "cinder-quobyte-bc7d9fe6-900f-4827-9a11-3d9fba99a5c0" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d30f2c45-7e0f-4aa7-95f3-c7d248cc93c9 tempest-VolumesActionsTest-1768883894 None] Lock "cinder-quobyte-bc7d9fe6-900f-4827-9a11-3d9fba99a5c0" acquired by "delete_volume" :: waited 0.025s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a2e1e6-04f8-41eb-990b-5f289d076a0f]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d30f2c45-7e0f-4aa7-95f3-c7d248cc93c9 tempest-VolumesActionsTest-1768883894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-bc7d9fe6-900f-4827-9a11-3d9fba99a5c0 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-bc508860-c678-4df5-9d91-ac8526d297db tempest-VolumesGetTest-1017574975 None] Created reservations ['61aa56aa-094d-47a0-bf15-ec81f8c08c04', '5a89f004-1c32-44d5-9f56-671b356e9be8', '10a2a679-5e80-4512-b7d7-a89212774700', '93748ef5-1bd6-4f65-a04d-baddb6fface5'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bc508860-c678-4df5-9d91-ac8526d297db tempest-VolumesGetTest-1017574975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bc508860-c678-4df5-9d91-ac8526d297db tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bc508860-c678-4df5-9d91-ac8526d297db tempest-VolumesGetTest-1017574975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bc508860-c678-4df5-9d91-ac8526d297db tempest-VolumesGetTest-1017574975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bc508860-c678-4df5-9d91-ac8526d297db tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc508860-c678-4df5-9d91-ac8526d297db tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:50 devstack sudo[88231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:32:50 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:50 devstack sudo[88227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-bc7d9fe6-900f-4827-9a11-3d9fba99a5c0 Feb 27 12:32:50 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:50 devstack sudo[88224]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-307d9f5d-6b47-43e2-9af7-f7151aff80ad tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d" returned: 0 in 0.675s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-307d9f5d-6b47-43e2-9af7-f7151aff80ad tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d.8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:50 devstack sudo[88234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d.8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9 1G Feb 27 12:32:50 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:50 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc508860-c678-4df5-9d91-ac8526d297db tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.485s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:50 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-bc508860-c678-4df5-9d91-ac8526d297db tempest-VolumesGetTest-1017574975 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:50 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:50 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-bc508860-c678-4df5-9d91-ac8526d297db tempest-VolumesGetTest-1017574975 None] Deleted volume successfully. Feb 27 12:32:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d30f2c45-7e0f-4aa7-95f3-c7d248cc93c9 tempest-VolumesActionsTest-1768883894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-bc7d9fe6-900f-4827-9a11-3d9fba99a5c0" returned: 0 in 0.591s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d30f2c45-7e0f-4aa7-95f3-c7d248cc93c9 tempest-VolumesActionsTest-1768883894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-bc7d9fe6-900f-4827-9a11-3d9fba99a5c0 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:50 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc508860-c678-4df5-9d91-ac8526d297db tempest-VolumesGetTest-1017574975 None] Lock "cinder-31bc5baa-8050-46fb-96b7-4af92e44e2a2-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:50 devstack sudo[88243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-bc7d9fe6-900f-4827-9a11-3d9fba99a5c0 Feb 27 12:32:50 devstack sudo[88243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:50 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-307d9f5d-6b47-43e2-9af7-f7151aff80ad tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d.8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9 1G" returned: 0 in 0.583s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-307d9f5d-6b47-43e2-9af7-f7151aff80ad tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8640575c-1ec1-4b4b-920b-a27d381bae1d -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d.8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:50 devstack sudo[88245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8640575c-1ec1-4b4b-920b-a27d381bae1d -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d.8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9 Feb 27 12:32:50 devstack sudo[88245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:51 devstack sudo[88243]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d30f2c45-7e0f-4aa7-95f3-c7d248cc93c9 tempest-VolumesActionsTest-1768883894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-bc7d9fe6-900f-4827-9a11-3d9fba99a5c0" returned: 0 in 0.520s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:51 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d30f2c45-7e0f-4aa7-95f3-c7d248cc93c9 tempest-VolumesActionsTest-1768883894 None] Lock "cinder-quobyte-bc7d9fe6-900f-4827-9a11-3d9fba99a5c0" released by "delete_volume" :: held 1.132s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:51 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a86f8a41-12a5-4ed6-926d-3812d9356154 tempest-VolumesGetTest-1017574975 None] Acquiring lock "cinder-62643c77-a1d3-4448-a5ad-550ec496411b-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:51 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a86f8a41-12a5-4ed6-926d-3812d9356154 tempest-VolumesGetTest-1017574975 None] Lock "cinder-62643c77-a1d3-4448-a5ad-550ec496411b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:51 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-d30f2c45-7e0f-4aa7-95f3-c7d248cc93c9 tempest-VolumesActionsTest-1768883894 None] Created reservations ['5c360ba2-8de8-401d-afe2-ae55571338b8', '599af37e-f3b0-4aaa-a6e0-79070909f905', '72d1c048-84c1-4733-9e83-61098ddbe7fc', '5897a6a8-3199-4357-afda-445f1161fd48'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:51 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a86f8a41-12a5-4ed6-926d-3812d9356154 tempest-VolumesGetTest-1017574975 None] Acquiring lock "cinder-quobyte-62643c77-a1d3-4448-a5ad-550ec496411b" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:51 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a86f8a41-12a5-4ed6-926d-3812d9356154 tempest-VolumesGetTest-1017574975 None] Lock "cinder-quobyte-62643c77-a1d3-4448-a5ad-550ec496411b" acquired by "delete_volume" :: waited 0.013s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:51 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed76bc4c-2f8a-4d53-9c0d-477fd02521e6]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a86f8a41-12a5-4ed6-926d-3812d9356154 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-62643c77-a1d3-4448-a5ad-550ec496411b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d30f2c45-7e0f-4aa7-95f3-c7d248cc93c9 tempest-VolumesActionsTest-1768883894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d30f2c45-7e0f-4aa7-95f3-c7d248cc93c9 tempest-VolumesActionsTest-1768883894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:51 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d30f2c45-7e0f-4aa7-95f3-c7d248cc93c9 tempest-VolumesActionsTest-1768883894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:51 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d30f2c45-7e0f-4aa7-95f3-c7d248cc93c9 tempest-VolumesActionsTest-1768883894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d30f2c45-7e0f-4aa7-95f3-c7d248cc93c9 tempest-VolumesActionsTest-1768883894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d30f2c45-7e0f-4aa7-95f3-c7d248cc93c9 tempest-VolumesActionsTest-1768883894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:51 devstack sudo[88253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:32:51 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:51 devstack sudo[88252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-62643c77-a1d3-4448-a5ad-550ec496411b Feb 27 12:32:51 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:51 devstack sudo[88245]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-307d9f5d-6b47-43e2-9af7-f7151aff80ad tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8640575c-1ec1-4b4b-920b-a27d381bae1d -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d.8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9" returned: 0 in 0.576s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:51 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-307d9f5d-6b47-43e2-9af7-f7151aff80ad tempest-CreateVolumesFromSnapshotTest-84566612 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d.8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9 is being set with open permissions: ugo+rw Feb 27 12:32:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-307d9f5d-6b47-43e2-9af7-f7151aff80ad tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d.8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:51 devstack sudo[88259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d.8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9 Feb 27 12:32:51 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:51 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d30f2c45-7e0f-4aa7-95f3-c7d248cc93c9 tempest-VolumesActionsTest-1768883894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.460s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:51 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-d30f2c45-7e0f-4aa7-95f3-c7d248cc93c9 tempest-VolumesActionsTest-1768883894 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:51 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-d30f2c45-7e0f-4aa7-95f3-c7d248cc93c9 tempest-VolumesActionsTest-1768883894 None] Deleted volume successfully. Feb 27 12:32:51 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d30f2c45-7e0f-4aa7-95f3-c7d248cc93c9 tempest-VolumesActionsTest-1768883894 None] Lock "cinder-bc7d9fe6-900f-4827-9a11-3d9fba99a5c0-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:51 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a86f8a41-12a5-4ed6-926d-3812d9356154 tempest-VolumesGetTest-1017574975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-62643c77-a1d3-4448-a5ad-550ec496411b" returned: 0 in 0.517s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a86f8a41-12a5-4ed6-926d-3812d9356154 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-62643c77-a1d3-4448-a5ad-550ec496411b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:51 devstack sudo[88266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-62643c77-a1d3-4448-a5ad-550ec496411b Feb 27 12:32:51 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:51 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-307d9f5d-6b47-43e2-9af7-f7151aff80ad tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d.8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9" returned: 0 in 0.461s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-307d9f5d-6b47-43e2-9af7-f7151aff80ad tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:51 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d.info Feb 27 12:32:51 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:52 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a86f8a41-12a5-4ed6-926d-3812d9356154 tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-62643c77-a1d3-4448-a5ad-550ec496411b" returned: 0 in 0.491s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a86f8a41-12a5-4ed6-926d-3812d9356154 tempest-VolumesGetTest-1017574975 None] Lock "cinder-quobyte-62643c77-a1d3-4448-a5ad-550ec496411b" released by "delete_volume" :: held 1.046s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-a86f8a41-12a5-4ed6-926d-3812d9356154 tempest-VolumesGetTest-1017574975 None] Created reservations ['dcc37aa0-918a-4322-8271-a2983e4529ca', 'fa8aad9f-1b44-4b47-b44f-63912fa6e21a', '72d001b2-da5b-4b6c-8021-a1ac8a718b96', '77b17304-5e8f-4024-ab85-8a5afc5adc9f'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:52 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-307d9f5d-6b47-43e2-9af7-f7151aff80ad tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d.info" returned: 0 in 0.499s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:52 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-307d9f5d-6b47-43e2-9af7-f7151aff80ad tempest-CreateVolumesFromSnapshotTest-84566612 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d.info is being set with open permissions: ugo+rw Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-307d9f5d-6b47-43e2-9af7-f7151aff80ad tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:52 devstack sudo[88272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d.info Feb 27 12:32:52 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a86f8a41-12a5-4ed6-926d-3812d9356154 tempest-VolumesGetTest-1017574975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a86f8a41-12a5-4ed6-926d-3812d9356154 tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a86f8a41-12a5-4ed6-926d-3812d9356154 tempest-VolumesGetTest-1017574975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a86f8a41-12a5-4ed6-926d-3812d9356154 tempest-VolumesGetTest-1017574975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a86f8a41-12a5-4ed6-926d-3812d9356154 tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a86f8a41-12a5-4ed6-926d-3812d9356154 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:52 devstack sudo[88274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:32:52 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Flow 'volume_create_manager' (0df4b2f0-5448-4adf-b496-8430e9154538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bacb641a-7e79-46ad-9167-1672b6cad7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bacb641a-7e79-46ad-9167-1672b6cad7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2083204119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b06b528-58dc-4070-8bc8-20fa9ca9c811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bbb9c48c5994e6abcb3dd6162a2e570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:52Z,use_quota=True,user_id='4e2d208287834932bacc02ee314a8619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8edfbb41-3cc6-4fd4-9275-cab4eb9e8520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8edfbb41-3cc6-4fd4-9275-cab4eb9e8520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e5994b-015f-4ac3-82dc-5e3426f189a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e5994b-015f-4ac3-82dc-5e3426f189a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b06b528-58dc-4070-8bc8-20fa9ca9c811', 'volume_name': 'volume-5b06b528-58dc-4070-8bc8-20fa9ca9c811', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53879261-471a-4da2-8929-800093ccbdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53879261-471a-4da2-8929-800093ccbdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0366f2c9-4d41-4c87-bd67-0d4dd123091a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:52 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Volume 5b06b528-58dc-4070-8bc8-20fa9ca9c811: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b06b528-58dc-4070-8bc8-20fa9ca9c811', 'volume_size': 1} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:52 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-307d9f5d-6b47-43e2-9af7-f7151aff80ad tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d.info" returned: 0 in 0.442s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-307d9f5d-6b47-43e2-9af7-f7151aff80ad tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.312s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.174s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2083204119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b06b528-58dc-4070-8bc8-20fa9ca9c811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bbb9c48c5994e6abcb3dd6162a2e570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:52Z,use_quota=True,user_id='4e2d208287834932bacc02ee314a8619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Creating volume 5b06b528-58dc-4070-8bc8-20fa9ca9c811 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:52 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5b06b528-58dc-4070-8bc8-20fa9ca9c811 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:52 devstack sudo[88278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5b06b528-58dc-4070-8bc8-20fa9ca9c811 1073741824 Feb 27 12:32:52 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:52 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-307d9f5d-6b47-43e2-9af7-f7151aff80ad tempest-CreateVolumesFromSnapshotTest-84566612 None] Create snapshot completed successfully Feb 27 12:32:52 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a86f8a41-12a5-4ed6-926d-3812d9356154 tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.481s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-a86f8a41-12a5-4ed6-926d-3812d9356154 tempest-VolumesGetTest-1017574975 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:52 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-a86f8a41-12a5-4ed6-926d-3812d9356154 tempest-VolumesGetTest-1017574975 None] Deleted volume successfully. Feb 27 12:32:52 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a86f8a41-12a5-4ed6-926d-3812d9356154 tempest-VolumesGetTest-1017574975 None] Lock "cinder-62643c77-a1d3-4448-a5ad-550ec496411b-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:53 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b66c9474-ac19-44a4-afd4-f7d80a11e1a7 tempest-VolumesGetTest-1017574975 None] Acquiring lock "cinder-e9de99f4-09ea-42a2-a90b-091add649720-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:53 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b66c9474-ac19-44a4-afd4-f7d80a11e1a7 tempest-VolumesGetTest-1017574975 None] Lock "cinder-e9de99f4-09ea-42a2-a90b-091add649720-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:53 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b66c9474-ac19-44a4-afd4-f7d80a11e1a7 tempest-VolumesGetTest-1017574975 None] Acquiring lock "cinder-quobyte-e9de99f4-09ea-42a2-a90b-091add649720" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:53 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b66c9474-ac19-44a4-afd4-f7d80a11e1a7 tempest-VolumesGetTest-1017574975 None] Lock "cinder-quobyte-e9de99f4-09ea-42a2-a90b-091add649720" acquired by "delete_volume" :: waited 0.039s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:53 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[068b05c6-9ea5-4c07-8577-3e16eb05306f]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b66c9474-ac19-44a4-afd4-f7d80a11e1a7 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:53 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:53 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:53 devstack sudo[88309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720 Feb 27 12:32:53 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:53 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Flow 'volume_create_manager' (e0c612f9-5997-4764-9685-bd705b0fc52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:53 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c06f89d-344a-431b-aa45-260bf2300394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5b06b528-58dc-4070-8bc8-20fa9ca9c811 1073741824" returned: 0 in 1.211s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:53 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c06f89d-344a-431b-aa45-260bf2300394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1579814644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac4eca6-480b-4ac7-a595-0466524af2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58b02d247ec34f9a8572656664154212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:54Z,use_quota=True,user_id='61d8c408bf714321b863f937cf793d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:53 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5351d0ea-3361-4c58-9743-0afd0f0664d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:53 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5351d0ea-3361-4c58-9743-0afd0f0664d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e12fe7-28c8-4c1d-876e-a94e7df9911e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e12fe7-28c8-4c1d-876e-a94e7df9911e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fac4eca6-480b-4ac7-a595-0466524af2c0', 'volume_name': 'volume-fac4eca6-480b-4ac7-a595-0466524af2c0', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (116ccde5-cc88-4d57-953a-ece2734f0a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (116ccde5-cc88-4d57-953a-ece2734f0a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29410579-315c-4e8c-af07-4997b8af312d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:54 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Volume fac4eca6-480b-4ac7-a595-0466524af2c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fac4eca6-480b-4ac7-a595-0466524af2c0', 'volume_size': 1} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Flow 'volume_create_manager' (05faaff8-8eae-4b05-a6c1-643f90524ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d305c14e-fc77-440d-9b6a-49dc058b6884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5b06b528-58dc-4070-8bc8-20fa9ca9c811 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d305c14e-fc77-440d-9b6a-49dc058b6884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1937066486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58b02d247ec34f9a8572656664154212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:54Z,use_quota=True,user_id='61d8c408bf714321b863f937cf793d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:54 devstack sudo[88312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5b06b528-58dc-4070-8bc8-20fa9ca9c811 Feb 27 12:32:54 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aabcea8-7d4c-4dff-af72-c3c9facc9c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aabcea8-7d4c-4dff-af72-c3c9facc9c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bee04ec-12a8-4f9a-a416-9bad9fe017a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bee04ec-12a8-4f9a-a416-9bad9fe017a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9', 'volume_name': 'volume-a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da88ee49-968c-47a6-bbef-85f840d11b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da88ee49-968c-47a6-bbef-85f840d11b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (828c74d6-2c6c-4e45-a4aa-6bebb99ed965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:54 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Volume a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9', 'volume_size': 1} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Flow 'volume_create_manager' (ec02bd78-0757-44dc-a9bc-d108d6909cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49643c12-d90b-4081-8a9a-b6cd0a875252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49643c12-d90b-4081-8a9a-b6cd0a875252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1165323084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b968820-f1c3-466f-941b-273e1e080abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58b02d247ec34f9a8572656664154212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:55Z,use_quota=True,user_id='61d8c408bf714321b863f937cf793d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff898a1-9cd1-45a6-8910-1d4ec65f2bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff898a1-9cd1-45a6-8910-1d4ec65f2bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6861f18e-8023-4509-a4d5-21d6d0835057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6861f18e-8023-4509-a4d5-21d6d0835057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b968820-f1c3-466f-941b-273e1e080abe', 'volume_name': 'volume-8b968820-f1c3-466f-941b-273e1e080abe', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614a6c87-5205-404a-8485-b7d677772f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614a6c87-5205-404a-8485-b7d677772f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4aaca5d-124b-4ca6-9cb7-0d85345dccab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:54 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Volume 8b968820-f1c3-466f-941b-273e1e080abe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b968820-f1c3-466f-941b-273e1e080abe', 'volume_size': 1} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:54 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b66c9474-ac19-44a4-afd4-f7d80a11e1a7 tempest-VolumesGetTest-1017574975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720" returned: 0 in 1.112s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b66c9474-ac19-44a4-afd4-f7d80a11e1a7 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:54 devstack sudo[88317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720 Feb 27 12:32:54 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Flow 'volume_create_manager' (a96526c9-6959-40db-8509-ead278d65ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (884d64f7-448b-41f0-974f-ace09211b786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (884d64f7-448b-41f0-974f-ace09211b786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1107495682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a784e1a-d174-40b0-aaf5-64021f871332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58b02d247ec34f9a8572656664154212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:55Z,use_quota=True,user_id='61d8c408bf714321b863f937cf793d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45efdd73-d014-430d-98b6-580d4ce0df22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45efdd73-d014-430d-98b6-580d4ce0df22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d60e730-c677-4381-8c06-3d760a71f11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d60e730-c677-4381-8c06-3d760a71f11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a784e1a-d174-40b0-aaf5-64021f871332', 'volume_name': 'volume-7a784e1a-d174-40b0-aaf5-64021f871332', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (009eadd1-3edb-4935-b852-b3fb5d06416f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (009eadd1-3edb-4935-b852-b3fb5d06416f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc85be0f-a579-4699-b4ae-dd9459b57e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:55 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Volume 7a784e1a-d174-40b0-aaf5-64021f871332: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a784e1a-d174-40b0-aaf5-64021f871332', 'volume_size': 1} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:55 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:55 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b66c9474-ac19-44a4-afd4-f7d80a11e1a7 tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e9de99f4-09ea-42a2-a90b-091add649720" returned: 0 in 0.659s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b66c9474-ac19-44a4-afd4-f7d80a11e1a7 tempest-VolumesGetTest-1017574975 None] Lock "cinder-quobyte-e9de99f4-09ea-42a2-a90b-091add649720" released by "delete_volume" :: held 1.845s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5b06b528-58dc-4070-8bc8-20fa9ca9c811" returned: 0 in 1.250s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] <== create_volume: return (2761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.764s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.361s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1579814644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac4eca6-480b-4ac7-a595-0466524af2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58b02d247ec34f9a8572656664154212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:54Z,use_quota=True,user_id='61d8c408bf714321b863f937cf793d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Creating volume fac4eca6-480b-4ac7-a595-0466524af2c0 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:55 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fac4eca6-480b-4ac7-a595-0466524af2c0 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0366f2c9-4d41-4c87-bd67-0d4dd123091a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b06b528-58dc-4070-8bc8-20fa9ca9c811', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b66e5bb5-1cbb-48dd-bbf8-9fc664a41150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:55 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Volume volume-5b06b528-58dc-4070-8bc8-20fa9ca9c811 (5b06b528-58dc-4070-8bc8-20fa9ca9c811): created successfully Feb 27 12:32:55 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fac4eca6-480b-4ac7-a595-0466524af2c0 1073741824 Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b66e5bb5-1cbb-48dd-bbf8-9fc664a41150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:55 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Flow 'volume_create_manager' (0df4b2f0-5448-4adf-b496-8430e9154538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:55 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-bd45e588-ca13-44ef-a3ee-055267819689 tempest-VolumesActionsTest-1685731934 None] Created volume successfully. Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-b66c9474-ac19-44a4-afd4-f7d80a11e1a7 tempest-VolumesGetTest-1017574975 None] Created reservations ['abe45372-7b41-42a2-a25f-b3ae920852b8', '4d041989-9c4c-46ee-bfda-b3e9c7f8738e', '0a614d69-804d-49dd-8dd9-59466c871ab4', '3a0f1a9f-fa69-4c04-9398-39027a67146f'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Flow 'volume_create_manager' (d4081b93-7efe-45e1-8d97-72a117c0ad33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8c2b37-d21b-4262-8b99-81f0d9abe206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8c2b37-d21b-4262-8b99-81f0d9abe206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-713285036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58b02d247ec34f9a8572656664154212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:56Z,use_quota=True,user_id='61d8c408bf714321b863f937cf793d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f8582e-3263-4df2-8b29-eac9c85a4f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f8582e-3263-4df2-8b29-eac9c85a4f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d1c3a78-04e9-43cc-aed3-737138a3e152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d1c3a78-04e9-43cc-aed3-737138a3e152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8', 'volume_name': 'volume-df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0cd77ab-bf81-4b25-b24c-1b03573d841d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0cd77ab-bf81-4b25-b24c-1b03573d841d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b2c53f-f9e7-49d2-af93-cc47915c0a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:55 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Volume df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8', 'volume_size': 1} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b66c9474-ac19-44a4-afd4-f7d80a11e1a7 tempest-VolumesGetTest-1017574975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b66c9474-ac19-44a4-afd4-f7d80a11e1a7 tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b66c9474-ac19-44a4-afd4-f7d80a11e1a7 tempest-VolumesGetTest-1017574975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b66c9474-ac19-44a4-afd4-f7d80a11e1a7 tempest-VolumesGetTest-1017574975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b66c9474-ac19-44a4-afd4-f7d80a11e1a7 tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b66c9474-ac19-44a4-afd4-f7d80a11e1a7 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:55 devstack sudo[88323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:32:55 devstack sudo[88323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:56 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7a0663ad-aa93-4229-870a-f7cc0e755bbb tempest-VolumesActionsTest-1768883894 None] Acquiring lock "cinder-5b06b528-58dc-4070-8bc8-20fa9ca9c811-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:56 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7a0663ad-aa93-4229-870a-f7cc0e755bbb tempest-VolumesActionsTest-1768883894 None] Lock "cinder-5b06b528-58dc-4070-8bc8-20fa9ca9c811-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:56 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7a0663ad-aa93-4229-870a-f7cc0e755bbb tempest-VolumesActionsTest-1768883894 None] Acquiring lock "cinder-quobyte-5b06b528-58dc-4070-8bc8-20fa9ca9c811" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:56 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7a0663ad-aa93-4229-870a-f7cc0e755bbb tempest-VolumesActionsTest-1768883894 None] Lock "cinder-quobyte-5b06b528-58dc-4070-8bc8-20fa9ca9c811" acquired by "delete_volume" :: waited 0.059s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:56 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb36cd79-5b8d-4558-b14c-9d1961c1dafc]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7a0663ad-aa93-4229-870a-f7cc0e755bbb tempest-VolumesActionsTest-1768883894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5b06b528-58dc-4070-8bc8-20fa9ca9c811 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:56 devstack sudo[88329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5b06b528-58dc-4070-8bc8-20fa9ca9c811 Feb 27 12:32:56 devstack sudo[88329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:56 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fac4eca6-480b-4ac7-a595-0466524af2c0 1073741824" returned: 0 in 1.303s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fac4eca6-480b-4ac7-a595-0466524af2c0 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:56 devstack sudo[88323]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b66c9474-ac19-44a4-afd4-f7d80a11e1a7 tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 1.094s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:56 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fac4eca6-480b-4ac7-a595-0466524af2c0 Feb 27 12:32:56 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:56 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-b66c9474-ac19-44a4-afd4-f7d80a11e1a7 tempest-VolumesGetTest-1017574975 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:56 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-b66c9474-ac19-44a4-afd4-f7d80a11e1a7 tempest-VolumesGetTest-1017574975 None] Deleted volume successfully. Feb 27 12:32:56 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b66c9474-ac19-44a4-afd4-f7d80a11e1a7 tempest-VolumesGetTest-1017574975 None] Lock "cinder-e9de99f4-09ea-42a2-a90b-091add649720-delete_volume" released by "delete_volume" :: held 3.467s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Flow 'volume_create_manager' (7ae24b6e-77d8-450a-8b2c-ea175d1ab311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad26400c-2300-4ea1-94b4-7a61e92fa705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad26400c-2300-4ea1-94b4-7a61e92fa705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-285735891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cde1383-0251-4bca-9000-5d19ec50de9c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='655c8c0f922e44f3b9ad9120a1db37bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:57Z,use_quota=True,user_id='d8bd1aefa8014a9c8f4d8be50a476d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636f56e5-10bf-4fe0-aaf5-41647f90fad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636f56e5-10bf-4fe0-aaf5-41647f90fad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19f27cbd-ed08-4c99-acc0-281dffe89d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG cinder.image.glance [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Creating Keystone auth plugin from conf {{(pid=83077) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19f27cbd-ed08-4c99-acc0-281dffe89d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6cde1383-0251-4bca-9000-5d19ec50de9c', 'volume_name': 'volume-6cde1383-0251-4bca-9000-5d19ec50de9c', 'volume_size': 1, 'image_id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c0a1769-4e00-41fd-a047-783ef98efe34', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa6a7971cf2a477f87f22a9fc435f45d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'created_at': datetime.datetime(2026, 2, 27, 11, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 11, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c0a1769-4e00-41fd-a047-783ef98efe34/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe0f391-b970-4711-9d64-4c3d147a8eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:57 devstack sudo[88329]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe0f391-b970-4711-9d64-4c3d147a8eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9b7086-c717-4741-a883-9c53f6472b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:57 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Volume 6cde1383-0251-4bca-9000-5d19ec50de9c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6cde1383-0251-4bca-9000-5d19ec50de9c', 'volume_size': 1, 'image_id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c0a1769-4e00-41fd-a047-783ef98efe34', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa6a7971cf2a477f87f22a9fc435f45d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'created_at': datetime.datetime(2026, 2, 27, 11, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 11, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c0a1769-4e00-41fd-a047-783ef98efe34/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Trying to clone 6cde1383-0251-4bca-9000-5d19ec50de9c from image 9c0a1769-4e00-41fd-a047-783ef98efe34 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9c0a1769-4e00-41fd-a047-783ef98efe34', 'metadata': {}}]). {{(pid=83077) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7a0663ad-aa93-4229-870a-f7cc0e755bbb tempest-VolumesActionsTest-1768883894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5b06b528-58dc-4070-8bc8-20fa9ca9c811" returned: 0 in 1.179s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7a0663ad-aa93-4229-870a-f7cc0e755bbb tempest-VolumesActionsTest-1768883894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5b06b528-58dc-4070-8bc8-20fa9ca9c811 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:57 devstack sudo[88361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5b06b528-58dc-4070-8bc8-20fa9ca9c811 Feb 27 12:32:57 devstack sudo[88361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:57 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fac4eca6-480b-4ac7-a595-0466524af2c0" returned: 0 in 0.809s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] <== create_volume: return (2194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.197s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.313s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1937066486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58b02d247ec34f9a8572656664154212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:54Z,use_quota=True,user_id='61d8c408bf714321b863f937cf793d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Creating volume a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:57 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29410579-315c-4e8c-af07-4997b8af312d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fac4eca6-480b-4ac7-a595-0466524af2c0', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46536a2a-f61d-4f58-b980-62e7d3cba5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:57 devstack sudo[88364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9 1073741824 Feb 27 12:32:57 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:57 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Volume volume-fac4eca6-480b-4ac7-a595-0466524af2c0 (fac4eca6-480b-4ac7-a595-0466524af2c0): created successfully Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46536a2a-f61d-4f58-b980-62e7d3cba5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Flow 'volume_create_manager' (e0c612f9-5997-4764-9685-bd705b0fc52e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:57 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-56604a0f-0a84-45ed-bb33-e93494c05669 tempest-CreateVolumesFromSnapshotTest-84566612 None] Created volume successfully. Feb 27 12:32:58 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_u914wuvddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83077) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 12:32:58 devstack cinder-volume[83077]: INFO cinder.image.image_utils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Image download 20.69 MB at 20.69 MB/s Feb 27 12:32:58 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd6beb0-2764-4a80-8acc-a2059435c11d]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_u914wuvddevstack@QuobyteHD {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:58 devstack sudo[88367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_u914wuvddevstack@QuobyteHD Feb 27 12:32:58 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:58 devstack sudo[88361]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7a0663ad-aa93-4229-870a-f7cc0e755bbb tempest-VolumesActionsTest-1768883894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5b06b528-58dc-4070-8bc8-20fa9ca9c811" returned: 0 in 0.781s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:58 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7a0663ad-aa93-4229-870a-f7cc0e755bbb tempest-VolumesActionsTest-1768883894 None] Lock "cinder-quobyte-5b06b528-58dc-4070-8bc8-20fa9ca9c811" released by "delete_volume" :: held 2.001s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:58 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-7a0663ad-aa93-4229-870a-f7cc0e755bbb tempest-VolumesActionsTest-1768883894 None] Created reservations ['2e2dc5d8-33a0-47eb-9837-89db3f96003d', '2aaff0af-8915-41b2-a6b5-7ee4c6a9c519', '9b576519-ac2c-43ec-bc85-5a4850c875bd', 'dd59e39a-1684-4bec-b7c7-a49bdddeb045'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7a0663ad-aa93-4229-870a-f7cc0e755bbb tempest-VolumesActionsTest-1768883894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7a0663ad-aa93-4229-870a-f7cc0e755bbb tempest-VolumesActionsTest-1768883894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7a0663ad-aa93-4229-870a-f7cc0e755bbb tempest-VolumesActionsTest-1768883894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7a0663ad-aa93-4229-870a-f7cc0e755bbb tempest-VolumesActionsTest-1768883894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7a0663ad-aa93-4229-870a-f7cc0e755bbb tempest-VolumesActionsTest-1768883894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7a0663ad-aa93-4229-870a-f7cc0e755bbb tempest-VolumesActionsTest-1768883894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:58 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:32:58 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:58 devstack cinder-volume[83077]: DEBUG oslo_service.periodic_task [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83077) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 12:32:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:58 devstack sudo[88376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:32:58 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:58 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9 1073741824" returned: 0 in 1.027s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:58 devstack sudo[88381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9 Feb 27 12:32:58 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:58 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_u914wuvddevstack@QuobyteHD" returned: 0 in 0.815s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:58 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Temporary image 9c0a1769-4e00-41fd-a047-783ef98efe34 is fetched for user d8bd1aefa8014a9c8f4d8be50a476d02. {{(pid=83077) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 12:32:58 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8274575-c5f3-4d87-927b-9816668b8209]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_u914wuvddevstack@QuobyteHD {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:59 devstack sudo[88383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_u914wuvddevstack@QuobyteHD Feb 27 12:32:59 devstack sudo[88383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:59 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Flow 'volume_create_manager' (e70eb7f8-7a14-46c6-889a-38657f739df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd4efafb-1b6b-425b-8b63-d0fea5cf2bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7a0663ad-aa93-4229-870a-f7cc0e755bbb tempest-VolumesActionsTest-1768883894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.911s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-7a0663ad-aa93-4229-870a-f7cc0e755bbb tempest-VolumesActionsTest-1768883894 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:59 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-7a0663ad-aa93-4229-870a-f7cc0e755bbb tempest-VolumesActionsTest-1768883894 None] Deleted volume successfully. Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd4efafb-1b6b-425b-8b63-d0fea5cf2bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1848590903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d119db-c2a5-483c-a549-b1d785ff070c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bbb9c48c5994e6abcb3dd6162a2e570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:59Z,use_quota=True,user_id='4e2d208287834932bacc02ee314a8619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37c7842-9a62-4ac6-b4e5-53e730359e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37c7842-9a62-4ac6-b4e5-53e730359e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40a62115-53b7-4ea3-b12c-585e8c8441d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40a62115-53b7-4ea3-b12c-585e8c8441d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32d119db-c2a5-483c-a549-b1d785ff070c', 'volume_name': 'volume-32d119db-c2a5-483c-a549-b1d785ff070c', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd23f4ff-0ec8-4883-9e2f-452ccc6fa760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd23f4ff-0ec8-4883-9e2f-452ccc6fa760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd770617-05e2-49fc-9214-865e8a0014b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:59 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Volume 32d119db-c2a5-483c-a549-b1d785ff070c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32d119db-c2a5-483c-a549-b1d785ff070c', 'volume_size': 1} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7a0663ad-aa93-4229-870a-f7cc0e755bbb tempest-VolumesActionsTest-1768883894 None] Lock "cinder-5b06b528-58dc-4070-8bc8-20fa9ca9c811-delete_volume" released by "delete_volume" :: held 3.224s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:59 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 1.159s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:59 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9" returned: 0 in 0.956s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] <== create_volume: return (2070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.074s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1165323084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b968820-f1c3-466f-941b-273e1e080abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58b02d247ec34f9a8572656664154212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:55Z,use_quota=True,user_id='61d8c408bf714321b863f937cf793d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Creating volume 8b968820-f1c3-466f-941b-273e1e080abe {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:59 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8b968820-f1c3-466f-941b-273e1e080abe 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (828c74d6-2c6c-4e45-a4aa-6bebb99ed965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb7120a-7afa-4976-b7ac-78a421c6a636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:59 devstack sudo[88389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8b968820-f1c3-466f-941b-273e1e080abe 1073741824 Feb 27 12:32:59 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:59 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Volume volume-a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9 (a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9): created successfully Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb7120a-7afa-4976-b7ac-78a421c6a636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Flow 'volume_create_manager' (05faaff8-8eae-4b05-a6c1-643f90524ec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:59 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-635a5ef8-ec2f-40eb-b155-388b902a2388 tempest-CreateVolumesFromSnapshotTest-84566612 None] Created volume successfully. Feb 27 12:32:59 devstack sudo[88383]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_u914wuvddevstack@QuobyteHD" returned: 0 in 0.961s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:00 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8b968820-f1c3-466f-941b-273e1e080abe 1073741824" returned: 0 in 0.563s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8b968820-f1c3-466f-941b-273e1e080abe {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:00 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8b968820-f1c3-466f-941b-273e1e080abe Feb 27 12:33:00 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:00 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8b968820-f1c3-466f-941b-273e1e080abe" returned: 0 in 0.439s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:00 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.421s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:00 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1107495682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a784e1a-d174-40b0-aaf5-64021f871332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58b02d247ec34f9a8572656664154212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:55Z,use_quota=True,user_id='61d8c408bf714321b863f937cf793d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:00 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Creating volume 7a784e1a-d174-40b0-aaf5-64021f871332 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:00 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:00 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:00 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:00 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:33:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7a784e1a-d174-40b0-aaf5-64021f871332 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:00 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4aaca5d-124b-4ca6-9cb7-0d85345dccab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b968820-f1c3-466f-941b-273e1e080abe', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:00 devstack sudo[88411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7a784e1a-d174-40b0-aaf5-64021f871332 1073741824 Feb 27 12:33:00 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:00 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34cc1d31-f770-47e9-bee6-cee46c2f612e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:00 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Volume volume-8b968820-f1c3-466f-941b-273e1e080abe (8b968820-f1c3-466f-941b-273e1e080abe): created successfully Feb 27 12:33:00 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34cc1d31-f770-47e9-bee6-cee46c2f612e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:00 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Flow 'volume_create_manager' (ec02bd78-0757-44dc-a9bc-d108d6909cd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:00 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-92638ef7-6711-41bf-864e-d5eceff2eb34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Created volume successfully. Feb 27 12:33:01 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7a784e1a-d174-40b0-aaf5-64021f871332 1073741824" returned: 0 in 0.558s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7a784e1a-d174-40b0-aaf5-64021f871332 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:01 devstack sudo[88417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7a784e1a-d174-40b0-aaf5-64021f871332 Feb 27 12:33:01 devstack sudo[88417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:01 devstack sudo[88417]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7a784e1a-d174-40b0-aaf5-64021f871332" returned: 0 in 0.450s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:01 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.077s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:01 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-713285036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58b02d247ec34f9a8572656664154212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:56Z,use_quota=True,user_id='61d8c408bf714321b863f937cf793d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:01 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Creating volume df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:01 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:01 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:01 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:01 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:33:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:01 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc85be0f-a579-4699-b4ae-dd9459b57e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a784e1a-d174-40b0-aaf5-64021f871332', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:01 devstack sudo[88424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8 1073741824 Feb 27 12:33:01 devstack sudo[88424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:01 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de22d4ed-6d37-4c3e-a9e9-30f287f90f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:01 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Volume volume-7a784e1a-d174-40b0-aaf5-64021f871332 (7a784e1a-d174-40b0-aaf5-64021f871332): created successfully Feb 27 12:33:01 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de22d4ed-6d37-4c3e-a9e9-30f287f90f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:01 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Flow 'volume_create_manager' (a96526c9-6959-40db-8509-ead278d65ec9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:01 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-a32178d3-2abf-44fd-8d17-53977a9c5e54 tempest-CreateVolumesFromSnapshotTest-84566612 None] Created volume successfully. Feb 27 12:33:02 devstack sudo[88424]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8 1073741824" returned: 0 in 0.546s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:02 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8 Feb 27 12:33:02 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:02 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8" returned: 0 in 0.423s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:02 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.396s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:02 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1848590903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d119db-c2a5-483c-a549-b1d785ff070c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bbb9c48c5994e6abcb3dd6162a2e570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:59Z,use_quota=True,user_id='4e2d208287834932bacc02ee314a8619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:02 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Creating volume 32d119db-c2a5-483c-a549-b1d785ff070c {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:02 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:02 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:02 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:02 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:33:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-32d119db-c2a5-483c-a549-b1d785ff070c 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:02 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-32d119db-c2a5-483c-a549-b1d785ff070c 1073741824 Feb 27 12:33:02 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b2c53f-f9e7-49d2-af93-cc47915c0a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304518db-dac6-45c5-83ec-b352fefeb45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:02 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Volume volume-df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8 (df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8): created successfully Feb 27 12:33:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304518db-dac6-45c5-83ec-b352fefeb45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Flow 'volume_create_manager' (d4081b93-7efe-45e1-8d97-72a117c0ad33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:02 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-1aecbbd0-044b-49a8-9608-516169904270 tempest-CreateVolumesFromSnapshotTest-84566612 None] Created volume successfully. Feb 27 12:33:03 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-32d119db-c2a5-483c-a549-b1d785ff070c 1073741824" returned: 0 in 0.546s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-32d119db-c2a5-483c-a549-b1d785ff070c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:03 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-32d119db-c2a5-483c-a549-b1d785ff070c Feb 27 12:33:03 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cae52af4-27cd-4bba-a2d2-a4983538719b tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "cinder-df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cae52af4-27cd-4bba-a2d2-a4983538719b tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cae52af4-27cd-4bba-a2d2-a4983538719b tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "cinder-quobyte-df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cae52af4-27cd-4bba-a2d2-a4983538719b tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-quobyte-df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:03 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cad6e61-5b5f-4aad-b5b1-dfa63c299a19]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cae52af4-27cd-4bba-a2d2-a4983538719b tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:03 devstack sudo[88439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8 Feb 27 12:33:03 devstack sudo[88439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:03 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-32d119db-c2a5-483c-a549-b1d785ff070c" returned: 0 in 0.543s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:03 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.045s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:03 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-285735891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cde1383-0251-4bca-9000-5d19ec50de9c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='655c8c0f922e44f3b9ad9120a1db37bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:57Z,use_quota=True,user_id='d8bd1aefa8014a9c8f4d8be50a476d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:03 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Creating volume 6cde1383-0251-4bca-9000-5d19ec50de9c {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:03 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:03 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:03 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:03 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:33:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:03 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd770617-05e2-49fc-9214-865e8a0014b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32d119db-c2a5-483c-a549-b1d785ff070c', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:03 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d742655-2e2b-4dfd-9d70-d17c41d73cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:04 devstack sudo[88442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c 1073741824 Feb 27 12:33:04 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:04 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Volume volume-32d119db-c2a5-483c-a549-b1d785ff070c (32d119db-c2a5-483c-a549-b1d785ff070c): created successfully Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d742655-2e2b-4dfd-9d70-d17c41d73cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Flow 'volume_create_manager' (e70eb7f8-7a14-46c6-889a-38657f739df0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:04 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-79ee678d-e295-4a07-9eb0-eb45ac477e70 tempest-VolumesActionsTest-1685731934 None] Created volume successfully. Feb 27 12:33:04 devstack sudo[88439]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cae52af4-27cd-4bba-a2d2-a4983538719b tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8" returned: 0 in 0.560s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cae52af4-27cd-4bba-a2d2-a4983538719b tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:04 devstack sudo[88447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8 Feb 27 12:33:04 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Flow 'volume_create_manager' (d8205645-2d38-4ecb-91c0-31e7143786bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cddbb9f9-cb4c-4fd5-8a7e-cc871644d131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cddbb9f9-cb4c-4fd5-8a7e-cc871644d131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-813503801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5311a9a3-13d0-47cb-8af4-5a23f4498142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d234b9ee4e4d4b28bf057499a600d065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:04Z,use_quota=True,user_id='aa7216e3cacd493cb915008350497771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (444ba873-c2a2-464d-b5d4-31f3db2725c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (444ba873-c2a2-464d-b5d4-31f3db2725c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a8e1950-badd-431c-bfff-69a04a8162c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:04 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a8e1950-badd-431c-bfff-69a04a8162c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5311a9a3-13d0-47cb-8af4-5a23f4498142', 'volume_name': 'volume-5311a9a3-13d0-47cb-8af4-5a23f4498142', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7291475-6de5-4fd1-a81c-544e8742dd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7291475-6de5-4fd1-a81c-544e8742dd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d27aaa2-f4d0-4c53-9848-6c04053aad31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:04 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Volume 5311a9a3-13d0-47cb-8af4-5a23f4498142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5311a9a3-13d0-47cb-8af4-5a23f4498142', 'volume_size': 1} Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c 1073741824" returned: 0 in 0.557s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:04 devstack sudo[88452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c Feb 27 12:33:04 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d27783c5-fa3e-4c48-a8b4-7dbe3e37f2e7 tempest-VolumesActionsTest-1768883894 None] Acquiring lock "cinder-32d119db-c2a5-483c-a549-b1d785ff070c-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d27783c5-fa3e-4c48-a8b4-7dbe3e37f2e7 tempest-VolumesActionsTest-1768883894 None] Lock "cinder-32d119db-c2a5-483c-a549-b1d785ff070c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d27783c5-fa3e-4c48-a8b4-7dbe3e37f2e7 tempest-VolumesActionsTest-1768883894 None] Acquiring lock "cinder-quobyte-32d119db-c2a5-483c-a549-b1d785ff070c" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d27783c5-fa3e-4c48-a8b4-7dbe3e37f2e7 tempest-VolumesActionsTest-1768883894 None] Lock "cinder-quobyte-32d119db-c2a5-483c-a549-b1d785ff070c" acquired by "delete_volume" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[895ca1ca-4a82-4f29-b17d-1cfcd9298b0c]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d27783c5-fa3e-4c48-a8b4-7dbe3e37f2e7 tempest-VolumesActionsTest-1768883894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-32d119db-c2a5-483c-a549-b1d785ff070c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:04 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cae52af4-27cd-4bba-a2d2-a4983538719b tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8" returned: 0 in 0.645s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cae52af4-27cd-4bba-a2d2-a4983538719b tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-quobyte-df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8" released by "delete_volume" :: held 1.232s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-cae52af4-27cd-4bba-a2d2-a4983538719b tempest-CreateVolumesFromSnapshotTest-84566612 None] Created reservations ['4ad24332-b2ea-4233-a2cf-f3b78f25ae11', '7be9fd73-73bf-47e9-b832-3a98e11f7bb0', '8b758732-1c44-4bca-8f6d-9a7d1b5f073f', '5d6252ee-57d1-48e7-bae9-bff18da9b204'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:04 devstack sudo[88455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-32d119db-c2a5-483c-a549-b1d785ff070c Feb 27 12:33:04 devstack sudo[88455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-cae52af4-27cd-4bba-a2d2-a4983538719b tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-cae52af4-27cd-4bba-a2d2-a4983538719b tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-cae52af4-27cd-4bba-a2d2-a4983538719b tempest-CreateVolumesFromSnapshotTest-84566612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-cae52af4-27cd-4bba-a2d2-a4983538719b tempest-CreateVolumesFromSnapshotTest-84566612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-cae52af4-27cd-4bba-a2d2-a4983538719b tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cae52af4-27cd-4bba-a2d2-a4983538719b tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:04 devstack sudo[88457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:33:04 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:05 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c" returned: 0 in 0.517s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.546s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-813503801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5311a9a3-13d0-47cb-8af4-5a23f4498142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d234b9ee4e4d4b28bf057499a600d065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:04Z,use_quota=True,user_id='aa7216e3cacd493cb915008350497771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Creating volume 5311a9a3-13d0-47cb-8af4-5a23f4498142 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:05 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5311a9a3-13d0-47cb-8af4-5a23f4498142 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG cinder.volume.volume_utils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Attempting download of 9c0a1769-4e00-41fd-a047-783ef98efe34 ((None, [{'url': 'file:///opt/stack/data/glance/images/9c0a1769-4e00-41fd-a047-783ef98efe34', 'metadata': {}}])) to volume 6cde1383-0251-4bca-9000-5d19ec50de9c. {{(pid=83077) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 12:33:05 devstack sudo[88460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5311a9a3-13d0-47cb-8af4-5a23f4498142 1073741824 Feb 27 12:33:05 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[7737885b-ad81-4e6a-a09f-072315e39cfd]: (4, 'raw') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_cpr90mwg {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:05 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_cpr90mwg Feb 27 12:33:05 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:05 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cae52af4-27cd-4bba-a2d2-a4983538719b tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.458s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-cae52af4-27cd-4bba-a2d2-a4983538719b tempest-CreateVolumesFromSnapshotTest-84566612 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:05 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-cae52af4-27cd-4bba-a2d2-a4983538719b tempest-CreateVolumesFromSnapshotTest-84566612 None] Deleted volume successfully. Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cae52af4-27cd-4bba-a2d2-a4983538719b tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-df1a7ace-0cfe-44e8-8ab4-6fbc428f96e8-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:05 devstack sudo[88455]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d27783c5-fa3e-4c48-a8b4-7dbe3e37f2e7 tempest-VolumesActionsTest-1768883894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-32d119db-c2a5-483c-a549-b1d785ff070c" returned: 0 in 0.669s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d27783c5-fa3e-4c48-a8b4-7dbe3e37f2e7 tempest-VolumesActionsTest-1768883894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-32d119db-c2a5-483c-a549-b1d785ff070c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:05 devstack sudo[88468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-32d119db-c2a5-483c-a549-b1d785ff070c Feb 27 12:33:05 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-dd87008e-df5d-4469-8f43-0e1e9cc433b2 tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "cinder-7a784e1a-d174-40b0-aaf5-64021f871332-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-dd87008e-df5d-4469-8f43-0e1e9cc433b2 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-7a784e1a-d174-40b0-aaf5-64021f871332-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:05 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5311a9a3-13d0-47cb-8af4-5a23f4498142 1073741824" returned: 0 in 0.707s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-dd87008e-df5d-4469-8f43-0e1e9cc433b2 tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "cinder-quobyte-7a784e1a-d174-40b0-aaf5-64021f871332" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5311a9a3-13d0-47cb-8af4-5a23f4498142 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-dd87008e-df5d-4469-8f43-0e1e9cc433b2 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-quobyte-7a784e1a-d174-40b0-aaf5-64021f871332" acquired by "delete_volume" :: waited 0.023s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:05 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_cpr90mwg" returned: 0 in 0.728s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_cpr90mwg {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba0621c-a01f-4451-8ffd-52c946dd4849]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:05 devstack sudo[88475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5311a9a3-13d0-47cb-8af4-5a23f4498142 Feb 27 12:33:05 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dd87008e-df5d-4469-8f43-0e1e9cc433b2 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7a784e1a-d174-40b0-aaf5-64021f871332 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:06 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_cpr90mwg Feb 27 12:33:06 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:06 devstack sudo[88477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7a784e1a-d174-40b0-aaf5-64021f871332 Feb 27 12:33:06 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:06 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d27783c5-fa3e-4c48-a8b4-7dbe3e37f2e7 tempest-VolumesActionsTest-1768883894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-32d119db-c2a5-483c-a549-b1d785ff070c" returned: 0 in 0.665s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:06 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d27783c5-fa3e-4c48-a8b4-7dbe3e37f2e7 tempest-VolumesActionsTest-1768883894 None] Lock "cinder-quobyte-32d119db-c2a5-483c-a549-b1d785ff070c" released by "delete_volume" :: held 1.353s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:06 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-d27783c5-fa3e-4c48-a8b4-7dbe3e37f2e7 tempest-VolumesActionsTest-1768883894 None] Created reservations ['3f732c91-2fd1-4371-8c45-e3be2bfbf3c9', 'e05e7355-b219-46a4-8aef-e99543d668c4', 'b1fdc208-cde3-4955-8062-ae141b0dfade', '0ba98d32-c95e-4dfd-a020-0e5ba4709bc1'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d27783c5-fa3e-4c48-a8b4-7dbe3e37f2e7 tempest-VolumesActionsTest-1768883894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d27783c5-fa3e-4c48-a8b4-7dbe3e37f2e7 tempest-VolumesActionsTest-1768883894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:06 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d27783c5-fa3e-4c48-a8b4-7dbe3e37f2e7 tempest-VolumesActionsTest-1768883894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:06 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d27783c5-fa3e-4c48-a8b4-7dbe3e37f2e7 tempest-VolumesActionsTest-1768883894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d27783c5-fa3e-4c48-a8b4-7dbe3e37f2e7 tempest-VolumesActionsTest-1768883894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d27783c5-fa3e-4c48-a8b4-7dbe3e37f2e7 tempest-VolumesActionsTest-1768883894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:06 devstack sudo[88482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:33:06 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:06 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5311a9a3-13d0-47cb-8af4-5a23f4498142" returned: 0 in 0.584s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:06 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d27aaa2-f4d0-4c53-9848-6c04053aad31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5311a9a3-13d0-47cb-8af4-5a23f4498142', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3a03cd-e916-4ef8-85be-e65d5c309f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:06 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Volume volume-5311a9a3-13d0-47cb-8af4-5a23f4498142 (5311a9a3-13d0-47cb-8af4-5a23f4498142): created successfully Feb 27 12:33:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3a03cd-e916-4ef8-85be-e65d5c309f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Flow 'volume_create_manager' (d8205645-2d38-4ecb-91c0-31e7143786bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:06 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-fc712f41-6c93-424e-b581-eb9b5b8f38b5 tempest-ServersNegativeTestJSON-1710848624 None] Created volume successfully. Feb 27 12:33:06 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d27783c5-fa3e-4c48-a8b4-7dbe3e37f2e7 tempest-VolumesActionsTest-1768883894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.475s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:06 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-d27783c5-fa3e-4c48-a8b4-7dbe3e37f2e7 tempest-VolumesActionsTest-1768883894 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:06 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:06 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-d27783c5-fa3e-4c48-a8b4-7dbe3e37f2e7 tempest-VolumesActionsTest-1768883894 None] Deleted volume successfully. Feb 27 12:33:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_cpr90mwg" returned: 1 in 0.855s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_cpr90mwg' failed. Not Retrying. {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:33:06 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f19839-c31b-439d-93d0-1b3284cddaac]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_u914wuvddevstack@QuobyteHD {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:06 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dd87008e-df5d-4469-8f43-0e1e9cc433b2 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7a784e1a-d174-40b0-aaf5-64021f871332" returned: 0 in 0.861s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dd87008e-df5d-4469-8f43-0e1e9cc433b2 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7a784e1a-d174-40b0-aaf5-64021f871332 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:06 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d27783c5-fa3e-4c48-a8b4-7dbe3e37f2e7 tempest-VolumesActionsTest-1768883894 None] Lock "cinder-32d119db-c2a5-483c-a549-b1d785ff070c-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:06 devstack sudo[88492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7a784e1a-d174-40b0-aaf5-64021f871332 Feb 27 12:33:06 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:06 devstack sudo[88491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_u914wuvddevstack@QuobyteHD Feb 27 12:33:06 devstack sudo[88491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:33:07 devstack sudo[88491]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Flow 'volume_create_manager' (cd2a6030-79e4-4805-8d69-98e6b149b2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601eb8f4-d4d1-4d95-9e6e-3efb5401abc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_u914wuvddevstack@QuobyteHD" returned: 0 in 0.755s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] 9c0a1769-4e00-41fd-a047-783ef98efe34 was qcow2, converting to raw {{(pid=83077) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_u914wuvddevstack@QuobyteHD /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601eb8f4-d4d1-4d95-9e6e-3efb5401abc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1941138188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f2e3534-e891-450b-9ab2-682ca38caa84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bbb9c48c5994e6abcb3dd6162a2e570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:07Z,use_quota=True,user_id='4e2d208287834932bacc02ee314a8619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50643be1-a3f3-4f2a-9f4b-d318a849fce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:07 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50643be1-a3f3-4f2a-9f4b-d318a849fce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6653fbc6-4d40-420a-87a3-1c455e7f578b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6653fbc6-4d40-420a-87a3-1c455e7f578b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f2e3534-e891-450b-9ab2-682ca38caa84', 'volume_name': 'volume-1f2e3534-e891-450b-9ab2-682ca38caa84', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec94cf1-e6a4-41c8-a3b1-4ba0b823c067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec94cf1-e6a4-41c8-a3b1-4ba0b823c067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:07 devstack sudo[88499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_u914wuvddevstack@QuobyteHD /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c Feb 27 12:33:07 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4760ff7-4c61-4e82-aceb-6c867c3027e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:07 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Volume 1f2e3534-e891-450b-9ab2-682ca38caa84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f2e3534-e891-450b-9ab2-682ca38caa84', 'volume_size': 1} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1941138188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f2e3534-e891-450b-9ab2-682ca38caa84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bbb9c48c5994e6abcb3dd6162a2e570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:07Z,use_quota=True,user_id='4e2d208287834932bacc02ee314a8619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Creating volume 1f2e3534-e891-450b-9ab2-682ca38caa84 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:07 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1f2e3534-e891-450b-9ab2-682ca38caa84 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dd87008e-df5d-4469-8f43-0e1e9cc433b2 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7a784e1a-d174-40b0-aaf5-64021f871332" returned: 0 in 0.805s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-dd87008e-df5d-4469-8f43-0e1e9cc433b2 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-quobyte-7a784e1a-d174-40b0-aaf5-64021f871332" released by "delete_volume" :: held 1.726s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:07 devstack sudo[88501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1f2e3534-e891-450b-9ab2-682ca38caa84 1073741824 Feb 27 12:33:07 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-dd87008e-df5d-4469-8f43-0e1e9cc433b2 tempest-CreateVolumesFromSnapshotTest-84566612 None] Created reservations ['d99036f2-60da-4e9b-9c3d-d79ae0fe8aa3', '57920775-559c-4310-8d15-62f61ced4d12', '3b340e3c-fd66-484c-8d15-e320b038cf39', '76d58813-4269-43be-9b86-b506382c3eb5'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-dd87008e-df5d-4469-8f43-0e1e9cc433b2 tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-dd87008e-df5d-4469-8f43-0e1e9cc433b2 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-dd87008e-df5d-4469-8f43-0e1e9cc433b2 tempest-CreateVolumesFromSnapshotTest-84566612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-dd87008e-df5d-4469-8f43-0e1e9cc433b2 tempest-CreateVolumesFromSnapshotTest-84566612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-dd87008e-df5d-4469-8f43-0e1e9cc433b2 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dd87008e-df5d-4469-8f43-0e1e9cc433b2 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:07 devstack sudo[88503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:33:07 devstack sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Flow 'volume_create_manager' (6f623392-aeec-4d52-9bab-29bc47b4f694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b74c70-a31e-4efd-9797-3bc12335ba16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b74c70-a31e-4efd-9797-3bc12335ba16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-402510078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f30f520-0662-471f-b800-667878c5b6af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d234b9ee4e4d4b28bf057499a600d065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:08Z,use_quota=True,user_id='aa7216e3cacd493cb915008350497771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ccaafd-4f63-4bd6-8a77-f53d5642d292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ccaafd-4f63-4bd6-8a77-f53d5642d292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:08 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace5fe19-ac52-4b42-a587-49be7464c472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:08 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace5fe19-ac52-4b42-a587-49be7464c472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f30f520-0662-471f-b800-667878c5b6af', 'volume_name': 'volume-4f30f520-0662-471f-b800-667878c5b6af', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:08 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03304a91-a77e-4590-8861-6cc3a1f711e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:08 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03304a91-a77e-4590-8861-6cc3a1f711e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:08 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (694a76ec-d71c-4a27-ab45-ea7ec7fea1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:08 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Volume 4f30f520-0662-471f-b800-667878c5b6af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f30f520-0662-471f-b800-667878c5b6af', 'volume_size': 1} Feb 27 12:33:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:08 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-c8026df2-92e4-4331-8ae2-b053416e0643 tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "cinder-8b968820-f1c3-466f-941b-273e1e080abe-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:08 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-c8026df2-92e4-4331-8ae2-b053416e0643 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-8b968820-f1c3-466f-941b-273e1e080abe-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:08 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-c8026df2-92e4-4331-8ae2-b053416e0643 tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "cinder-quobyte-8b968820-f1c3-466f-941b-273e1e080abe" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:08 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-c8026df2-92e4-4331-8ae2-b053416e0643 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-quobyte-8b968820-f1c3-466f-941b-273e1e080abe" acquired by "delete_volume" :: waited 0.017s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:08 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[385e8a2d-c5cc-442f-967b-49f69897b27a]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c8026df2-92e4-4331-8ae2-b053416e0643 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8b968820-f1c3-466f-941b-273e1e080abe {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:08 devstack sudo[88508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8b968820-f1c3-466f-941b-273e1e080abe Feb 27 12:33:08 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:08 devstack sudo[88503]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dd87008e-df5d-4469-8f43-0e1e9cc433b2 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.712s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:08 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-dd87008e-df5d-4469-8f43-0e1e9cc433b2 tempest-CreateVolumesFromSnapshotTest-84566612 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:08 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-dd87008e-df5d-4469-8f43-0e1e9cc433b2 tempest-CreateVolumesFromSnapshotTest-84566612 None] Deleted volume successfully. Feb 27 12:33:08 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1f2e3534-e891-450b-9ab2-682ca38caa84 1073741824" returned: 0 in 0.894s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:08 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-dd87008e-df5d-4469-8f43-0e1e9cc433b2 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-7a784e1a-d174-40b0-aaf5-64021f871332-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1f2e3534-e891-450b-9ab2-682ca38caa84 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:08 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1f2e3534-e891-450b-9ab2-682ca38caa84 Feb 27 12:33:08 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:08 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_u914wuvddevstack@QuobyteHD /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c" returned: 0 in 1.386s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:08 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_u914wuvddevstack@QuobyteHD, size 112.00 MB, duration 1.39 sec, destination /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c {{(pid=83077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:33:08 devstack cinder-volume[83077]: INFO cinder.image.image_utils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Converted 112.00 MB image at 80.72 MB/s Feb 27 12:33:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:08 devstack sudo[88530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c 1G Feb 27 12:33:08 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:08 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c8026df2-92e4-4331-8ae2-b053416e0643 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8b968820-f1c3-466f-941b-273e1e080abe" returned: 0 in 0.837s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c8026df2-92e4-4331-8ae2-b053416e0643 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8b968820-f1c3-466f-941b-273e1e080abe {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:09 devstack sudo[88533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8b968820-f1c3-466f-941b-273e1e080abe Feb 27 12:33:09 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:09 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1f2e3534-e891-450b-9ab2-682ca38caa84" returned: 0 in 0.672s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.138s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-402510078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f30f520-0662-471f-b800-667878c5b6af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d234b9ee4e4d4b28bf057499a600d065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:08Z,use_quota=True,user_id='aa7216e3cacd493cb915008350497771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Creating volume 4f30f520-0662-471f-b800-667878c5b6af {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:09 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4f30f520-0662-471f-b800-667878c5b6af 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4760ff7-4c61-4e82-aceb-6c867c3027e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f2e3534-e891-450b-9ab2-682ca38caa84', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1db9332-97b6-4463-8df0-8245128fa9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:09 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Volume volume-1f2e3534-e891-450b-9ab2-682ca38caa84 (1f2e3534-e891-450b-9ab2-682ca38caa84): created successfully Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1db9332-97b6-4463-8df0-8245128fa9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Flow 'volume_create_manager' (cd2a6030-79e4-4805-8d69-98e6b149b2fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:09 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-5d6a043e-8a7b-4994-9f46-f37b83b7c116 tempest-VolumesActionsTest-1685731934 None] Created volume successfully. Feb 27 12:33:09 devstack sudo[88536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4f30f520-0662-471f-b800-667878c5b6af 1073741824 Feb 27 12:33:09 devstack sudo[88536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:09 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c 1G" returned: 0 in 0.564s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:09 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c8026df2-92e4-4331-8ae2-b053416e0643 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8b968820-f1c3-466f-941b-273e1e080abe" returned: 0 in 0.464s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-c8026df2-92e4-4331-8ae2-b053416e0643 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-quobyte-8b968820-f1c3-466f-941b-273e1e080abe" released by "delete_volume" :: held 1.337s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7696f6-c1ee-4a77-b47a-4deef9ded979]: (4, 'raw') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-c8026df2-92e4-4331-8ae2-b053416e0643 tempest-CreateVolumesFromSnapshotTest-84566612 None] Created reservations ['620945b6-e8dc-4dc3-a71b-dd232498f04d', '2701e452-1498-4a12-8f6c-c40f7177dc32', '11187e2e-db88-4198-8170-d4fafc0d9f65', '489803d8-19e1-453a-a62a-3244c045ebc4'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c8026df2-92e4-4331-8ae2-b053416e0643 tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c8026df2-92e4-4331-8ae2-b053416e0643 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c8026df2-92e4-4331-8ae2-b053416e0643 tempest-CreateVolumesFromSnapshotTest-84566612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c8026df2-92e4-4331-8ae2-b053416e0643 tempest-CreateVolumesFromSnapshotTest-84566612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c8026df2-92e4-4331-8ae2-b053416e0643 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c8026df2-92e4-4331-8ae2-b053416e0643 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:09 devstack sudo[88542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c Feb 27 12:33:09 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:09 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:33:09 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d5230cd6-847e-4663-8bdb-c3a92b258507 tempest-VolumesActionsTest-1768883894 None] Acquiring lock "cinder-1f2e3534-e891-450b-9ab2-682ca38caa84-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d5230cd6-847e-4663-8bdb-c3a92b258507 tempest-VolumesActionsTest-1768883894 None] Lock "cinder-1f2e3534-e891-450b-9ab2-682ca38caa84-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d5230cd6-847e-4663-8bdb-c3a92b258507 tempest-VolumesActionsTest-1768883894 None] Acquiring lock "cinder-quobyte-1f2e3534-e891-450b-9ab2-682ca38caa84" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d5230cd6-847e-4663-8bdb-c3a92b258507 tempest-VolumesActionsTest-1768883894 None] Lock "cinder-quobyte-1f2e3534-e891-450b-9ab2-682ca38caa84" acquired by "delete_volume" :: waited 0.013s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d540ea-f11d-442e-a032-48058f824719]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d5230cd6-847e-4663-8bdb-c3a92b258507 tempest-VolumesActionsTest-1768883894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1f2e3534-e891-450b-9ab2-682ca38caa84 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:09 devstack sudo[88549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1f2e3534-e891-450b-9ab2-682ca38caa84 Feb 27 12:33:09 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:10 devstack sudo[88536]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4f30f520-0662-471f-b800-667878c5b6af 1073741824" returned: 0 in 0.800s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4f30f520-0662-471f-b800-667878c5b6af {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:10 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4f30f520-0662-471f-b800-667878c5b6af Feb 27 12:33:10 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a8faca5b-cfa6-417f-b863-aefc0daf3d34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "cinder-a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:10 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a8faca5b-cfa6-417f-b863-aefc0daf3d34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9-delete_volume" acquired by "delete_volume" :: waited 0.162s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:10 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c" returned: 0 in 0.937s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:10 devstack cinder-volume[83077]: DEBUG dbcounter [-] [83077] Writing DB stats cinder:SELECT=166,cinder:INSERT=49,cinder:UPDATE=242,cinder:DELETE=21 {{(pid=83077) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:33:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c8026df2-92e4-4331-8ae2-b053416e0643 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.888s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:10 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-c8026df2-92e4-4331-8ae2-b053416e0643 tempest-CreateVolumesFromSnapshotTest-84566612 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:10 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-c8026df2-92e4-4331-8ae2-b053416e0643 tempest-CreateVolumesFromSnapshotTest-84566612 None] Deleted volume successfully. Feb 27 12:33:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a8faca5b-cfa6-417f-b863-aefc0daf3d34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "cinder-quobyte-a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-c8026df2-92e4-4331-8ae2-b053416e0643 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-8b968820-f1c3-466f-941b-273e1e080abe-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:10 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d5230cd6-847e-4663-8bdb-c3a92b258507 tempest-VolumesActionsTest-1768883894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1f2e3534-e891-450b-9ab2-682ca38caa84" returned: 0 in 0.693s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d5230cd6-847e-4663-8bdb-c3a92b258507 tempest-VolumesActionsTest-1768883894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1f2e3534-e891-450b-9ab2-682ca38caa84 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:10 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a8faca5b-cfa6-417f-b863-aefc0daf3d34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-quobyte-a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9" acquired by "delete_volume" :: waited 0.049s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4f30f520-0662-471f-b800-667878c5b6af" returned: 0 in 0.530s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:10 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:10 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1f2e3534-e891-450b-9ab2-682ca38caa84 Feb 27 12:33:10 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:10 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38e0e40-8733-4eff-a0e2-65d9e732f27a]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a8faca5b-cfa6-417f-b863-aefc0daf3d34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:10 devstack sudo[88558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c Feb 27 12:33:10 devstack sudo[88558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:10 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (694a76ec-d71c-4a27-ab45-ea7ec7fea1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f30f520-0662-471f-b800-667878c5b6af', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:10 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1fae539-dee9-42d0-b09e-432ae211a240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:10 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Volume volume-4f30f520-0662-471f-b800-667878c5b6af (4f30f520-0662-471f-b800-667878c5b6af): created successfully Feb 27 12:33:10 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1fae539-dee9-42d0-b09e-432ae211a240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:10 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Flow 'volume_create_manager' (6f623392-aeec-4d52-9bab-29bc47b4f694) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:10 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-c9c24225-5ff3-4a80-8b22-915675eedcd9 tempest-ServersNegativeTestJSON-1710848624 None] Created volume successfully. Feb 27 12:33:10 devstack sudo[88564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9 Feb 27 12:33:10 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:11 devstack sudo[88558]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c" returned: 1 in 0.712s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c' failed. Not Retrying. {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG cinder.volume.volume_utils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Downloaded image 9c0a1769-4e00-41fd-a047-783ef98efe34 ((None, [{'url': 'file:///opt/stack/data/glance/images/9c0a1769-4e00-41fd-a047-783ef98efe34', 'metadata': {}}])) to volume 6cde1383-0251-4bca-9000-5d19ec50de9c successfully. {{(pid=83077) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Temporary image 9c0a1769-4e00-41fd-a047-783ef98efe34 for user d8bd1aefa8014a9c8f4d8be50a476d02 is deleted. {{(pid=83077) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG cinder.volume.volume_utils [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Marking volume 6cde1383-0251-4bca-9000-5d19ec50de9c as bootable. {{(pid=83077) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Copying metadata from image 9c0a1769-4e00-41fd-a047-783ef98efe34 to 6cde1383-0251-4bca-9000-5d19ec50de9c. {{(pid=83077) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Creating volume glance metadata for volume 6cde1383-0251-4bca-9000-5d19ec50de9c backed by image 9c0a1769-4e00-41fd-a047-783ef98efe34 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83077) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 12:33:11 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d5230cd6-847e-4663-8bdb-c3a92b258507 tempest-VolumesActionsTest-1768883894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1f2e3534-e891-450b-9ab2-682ca38caa84" returned: 0 in 0.615s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d5230cd6-847e-4663-8bdb-c3a92b258507 tempest-VolumesActionsTest-1768883894 None] Lock "cinder-quobyte-1f2e3534-e891-450b-9ab2-682ca38caa84" released by "delete_volume" :: held 1.388s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9b7086-c717-4741-a883-9c53f6472b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cde1383-0251-4bca-9000-5d19ec50de9c', 'volume_size': 1, 'image_id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c0a1769-4e00-41fd-a047-783ef98efe34', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa6a7971cf2a477f87f22a9fc435f45d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'created_at': datetime.datetime(2026, 2, 27, 11, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 11, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c0a1769-4e00-41fd-a047-783ef98efe34/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32fa4e4c-a5e9-42a8-a6e8-14ba9011a6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:11 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Volume volume-6cde1383-0251-4bca-9000-5d19ec50de9c (6cde1383-0251-4bca-9000-5d19ec50de9c): created successfully Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32fa4e4c-a5e9-42a8-a6e8-14ba9011a6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Flow 'volume_create_manager' (7ae24b6e-77d8-450a-8b2c-ea175d1ab311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:11 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-daf17225-c10b-4abf-818a-b00fd0523ffe tempest-VolumesGetTest-1017574975 None] Created volume successfully. Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-d5230cd6-847e-4663-8bdb-c3a92b258507 tempest-VolumesActionsTest-1768883894 None] Created reservations ['4be92616-91ff-4988-acca-da70bc18b96a', '3c87fe53-c370-4dd7-bd5e-6f96fd3632ff', '92375aad-cd0c-4c9a-94a0-5f92fcc9bd48', 'e4e8f37d-1f36-4079-ba68-c5e9ba49b880'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:11 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a8faca5b-cfa6-417f-b863-aefc0daf3d34 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9" returned: 0 in 0.782s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a8faca5b-cfa6-417f-b863-aefc0daf3d34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d5230cd6-847e-4663-8bdb-c3a92b258507 tempest-VolumesActionsTest-1768883894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d5230cd6-847e-4663-8bdb-c3a92b258507 tempest-VolumesActionsTest-1768883894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d5230cd6-847e-4663-8bdb-c3a92b258507 tempest-VolumesActionsTest-1768883894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d5230cd6-847e-4663-8bdb-c3a92b258507 tempest-VolumesActionsTest-1768883894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d5230cd6-847e-4663-8bdb-c3a92b258507 tempest-VolumesActionsTest-1768883894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d5230cd6-847e-4663-8bdb-c3a92b258507 tempest-VolumesActionsTest-1768883894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:11 devstack sudo[88574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9 Feb 27 12:33:11 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-be3ffd53-6d2e-4166-84fb-98de233b7e60 tempest-ServersNegativeTestJSON-1710848624 None] Acquiring lock "cinder-4f30f520-0662-471f-b800-667878c5b6af-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:11 devstack sudo[88575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:33:11 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-be3ffd53-6d2e-4166-84fb-98de233b7e60 tempest-ServersNegativeTestJSON-1710848624 None] Lock "cinder-4f30f520-0662-471f-b800-667878c5b6af-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-be3ffd53-6d2e-4166-84fb-98de233b7e60 tempest-ServersNegativeTestJSON-1710848624 None] Acquiring lock "cinder-quobyte-4f30f520-0662-471f-b800-667878c5b6af" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-be3ffd53-6d2e-4166-84fb-98de233b7e60 tempest-ServersNegativeTestJSON-1710848624 None] Lock "cinder-quobyte-4f30f520-0662-471f-b800-667878c5b6af" acquired by "delete_volume" :: waited 0.007s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[095eb6e7-3cb7-423c-8f0d-b42c44ecdda6]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-be3ffd53-6d2e-4166-84fb-98de233b7e60 tempest-ServersNegativeTestJSON-1710848624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4f30f520-0662-471f-b800-667878c5b6af {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:11 devstack sudo[88578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4f30f520-0662-471f-b800-667878c5b6af Feb 27 12:33:11 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:11 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a8faca5b-cfa6-417f-b863-aefc0daf3d34 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9" returned: 0 in 0.452s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a8faca5b-cfa6-417f-b863-aefc0daf3d34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-quobyte-a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9" released by "delete_volume" :: held 1.263s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:11 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d5230cd6-847e-4663-8bdb-c3a92b258507 tempest-VolumesActionsTest-1768883894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.448s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-d5230cd6-847e-4663-8bdb-c3a92b258507 tempest-VolumesActionsTest-1768883894 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:11 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-d5230cd6-847e-4663-8bdb-c3a92b258507 tempest-VolumesActionsTest-1768883894 None] Deleted volume successfully. Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d5230cd6-847e-4663-8bdb-c3a92b258507 tempest-VolumesActionsTest-1768883894 None] Lock "cinder-1f2e3534-e891-450b-9ab2-682ca38caa84-delete_volume" released by "delete_volume" :: held 2.106s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-a8faca5b-cfa6-417f-b863-aefc0daf3d34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Created reservations ['65a5f107-cc32-4401-b2d3-e71df74db4df', '97422bf5-6c4c-4d5c-a764-6f5750130714', '8c7b0a8d-e527-45ec-9832-73265226de58', '57e19f7a-ab04-4792-b066-f96c49deebc3'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a8faca5b-cfa6-417f-b863-aefc0daf3d34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a8faca5b-cfa6-417f-b863-aefc0daf3d34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a8faca5b-cfa6-417f-b863-aefc0daf3d34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a8faca5b-cfa6-417f-b863-aefc0daf3d34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a8faca5b-cfa6-417f-b863-aefc0daf3d34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a8faca5b-cfa6-417f-b863-aefc0daf3d34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:11 devstack sudo[88585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:33:11 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:11 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-be3ffd53-6d2e-4166-84fb-98de233b7e60 tempest-ServersNegativeTestJSON-1710848624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4f30f520-0662-471f-b800-667878c5b6af" returned: 0 in 0.516s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-be3ffd53-6d2e-4166-84fb-98de233b7e60 tempest-ServersNegativeTestJSON-1710848624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4f30f520-0662-471f-b800-667878c5b6af {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:12 devstack sudo[88587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4f30f520-0662-471f-b800-667878c5b6af Feb 27 12:33:12 devstack sudo[88587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Flow 'volume_create_manager' (b1d741ab-d048-43b0-a75d-fc2e145cb576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8244ec2e-58db-4e4a-bdd7-a913cbb1c90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8244ec2e-58db-4e4a-bdd7-a913cbb1c90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-841737736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=964969a6-e7e5-4eb1-9801-96650834fe42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bbb9c48c5994e6abcb3dd6162a2e570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:12Z,use_quota=True,user_id='4e2d208287834932bacc02ee314a8619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3446859-5277-47f1-ae53-ef99e4863d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3446859-5277-47f1-ae53-ef99e4863d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872ab084-fc49-4213-818c-1a285ad722a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872ab084-fc49-4213-818c-1a285ad722a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '964969a6-e7e5-4eb1-9801-96650834fe42', 'volume_name': 'volume-964969a6-e7e5-4eb1-9801-96650834fe42', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4956193e-1942-4c38-a388-a9fcb6916f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4956193e-1942-4c38-a388-a9fcb6916f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58872eb1-d266-407b-9306-1cc98f5b082d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:12 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Volume 964969a6-e7e5-4eb1-9801-96650834fe42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-964969a6-e7e5-4eb1-9801-96650834fe42', 'volume_size': 1} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-841737736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=964969a6-e7e5-4eb1-9801-96650834fe42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bbb9c48c5994e6abcb3dd6162a2e570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:12Z,use_quota=True,user_id='4e2d208287834932bacc02ee314a8619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Creating volume 964969a6-e7e5-4eb1-9801-96650834fe42 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:12 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-964969a6-e7e5-4eb1-9801-96650834fe42 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:12 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a8faca5b-cfa6-417f-b863-aefc0daf3d34 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.521s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-a8faca5b-cfa6-417f-b863-aefc0daf3d34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:12 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-a8faca5b-cfa6-417f-b863-aefc0daf3d34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Deleted volume successfully. Feb 27 12:33:12 devstack sudo[88591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-964969a6-e7e5-4eb1-9801-96650834fe42 1073741824 Feb 27 12:33:12 devstack sudo[88591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a8faca5b-cfa6-417f-b863-aefc0daf3d34 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-a61c4101-1d7e-437f-8ec3-51ffb8c2c8f9-delete_volume" released by "delete_volume" :: held 2.060s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-0b38a550-7841-4631-9c2f-353603ad75f9 tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "cinder-fac4eca6-480b-4ac7-a595-0466524af2c0-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:12 devstack sudo[88587]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-be3ffd53-6d2e-4166-84fb-98de233b7e60 tempest-ServersNegativeTestJSON-1710848624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4f30f520-0662-471f-b800-667878c5b6af" returned: 0 in 0.493s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-0b38a550-7841-4631-9c2f-353603ad75f9 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-fac4eca6-480b-4ac7-a595-0466524af2c0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-be3ffd53-6d2e-4166-84fb-98de233b7e60 tempest-ServersNegativeTestJSON-1710848624 None] Lock "cinder-quobyte-4f30f520-0662-471f-b800-667878c5b6af" released by "delete_volume" :: held 1.035s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-0b38a550-7841-4631-9c2f-353603ad75f9 tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "cinder-quobyte-fac4eca6-480b-4ac7-a595-0466524af2c0" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-0b38a550-7841-4631-9c2f-353603ad75f9 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-quobyte-fac4eca6-480b-4ac7-a595-0466524af2c0" acquired by "delete_volume" :: waited 0.022s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdc4ebe-13ec-4923-9be2-c2d6dc516dd4]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0b38a550-7841-4631-9c2f-353603ad75f9 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fac4eca6-480b-4ac7-a595-0466524af2c0 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-be3ffd53-6d2e-4166-84fb-98de233b7e60 tempest-ServersNegativeTestJSON-1710848624 None] Created reservations ['1a16fda6-b6b6-40b8-a474-e18ccf05ee0a', 'd7f2f458-9902-4ed2-984f-3c1480e1e808', '557160a3-44c0-4c48-a186-1cde6e2ea845', '6a6e81e9-6af8-401f-9641-6035fe0264ea'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-be3ffd53-6d2e-4166-84fb-98de233b7e60 tempest-ServersNegativeTestJSON-1710848624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-be3ffd53-6d2e-4166-84fb-98de233b7e60 tempest-ServersNegativeTestJSON-1710848624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-be3ffd53-6d2e-4166-84fb-98de233b7e60 tempest-ServersNegativeTestJSON-1710848624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-be3ffd53-6d2e-4166-84fb-98de233b7e60 tempest-ServersNegativeTestJSON-1710848624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-be3ffd53-6d2e-4166-84fb-98de233b7e60 tempest-ServersNegativeTestJSON-1710848624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-be3ffd53-6d2e-4166-84fb-98de233b7e60 tempest-ServersNegativeTestJSON-1710848624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:12 devstack sudo[88594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:33:12 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:12 devstack sudo[88593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fac4eca6-480b-4ac7-a595-0466524af2c0 Feb 27 12:33:12 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Flow 'volume_create_manager' (06c5e07e-0bd6-4c1d-912c-2f805a250b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8cb890-ee04-457b-b9ab-bec2fa380f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8cb890-ee04-457b-b9ab-bec2fa380f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1562051808',display_name='tempest-VolumesGetTest-Volume-1826480902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c9eddb-3594-4521-b1aa-405279b16ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='655c8c0f922e44f3b9ad9120a1db37bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:13Z,use_quota=True,user_id='d8bd1aefa8014a9c8f4d8be50a476d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9932c263-384b-4160-8200-04aec22f69fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9932c263-384b-4160-8200-04aec22f69fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfdfc852-1287-411b-8fc1-f2edae3450cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfdfc852-1287-411b-8fc1-f2edae3450cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41c9eddb-3594-4521-b1aa-405279b16ded', 'volume_name': 'volume-41c9eddb-3594-4521-b1aa-405279b16ded', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf1f626-d75c-4022-a313-0d0d275e23cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf1f626-d75c-4022-a313-0d0d275e23cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd317d01-6bcd-4819-bf76-73ccd752e35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:12 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Volume 41c9eddb-3594-4521-b1aa-405279b16ded: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41c9eddb-3594-4521-b1aa-405279b16ded', 'volume_size': 1} Feb 27 12:33:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:13 devstack sudo[88591]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-964969a6-e7e5-4eb1-9801-96650834fe42 1073741824" returned: 0 in 0.591s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-964969a6-e7e5-4eb1-9801-96650834fe42 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:13 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-964969a6-e7e5-4eb1-9801-96650834fe42 Feb 27 12:33:13 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:13 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-be3ffd53-6d2e-4166-84fb-98de233b7e60 tempest-ServersNegativeTestJSON-1710848624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.461s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-be3ffd53-6d2e-4166-84fb-98de233b7e60 tempest-ServersNegativeTestJSON-1710848624 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:13 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-be3ffd53-6d2e-4166-84fb-98de233b7e60 tempest-ServersNegativeTestJSON-1710848624 None] Deleted volume successfully. Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-be3ffd53-6d2e-4166-84fb-98de233b7e60 tempest-ServersNegativeTestJSON-1710848624 None] Lock "cinder-4f30f520-0662-471f-b800-667878c5b6af-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:13 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0b38a550-7841-4631-9c2f-353603ad75f9 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fac4eca6-480b-4ac7-a595-0466524af2c0" returned: 0 in 0.597s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0b38a550-7841-4631-9c2f-353603ad75f9 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fac4eca6-480b-4ac7-a595-0466524af2c0 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:13 devstack sudo[88606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fac4eca6-480b-4ac7-a595-0466524af2c0 Feb 27 12:33:13 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:13 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-964969a6-e7e5-4eb1-9801-96650834fe42" returned: 0 in 0.429s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.609s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1562051808',display_name='tempest-VolumesGetTest-Volume-1826480902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c9eddb-3594-4521-b1aa-405279b16ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='655c8c0f922e44f3b9ad9120a1db37bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:13Z,use_quota=True,user_id='d8bd1aefa8014a9c8f4d8be50a476d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Creating volume 41c9eddb-3594-4521-b1aa-405279b16ded {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:13 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-41c9eddb-3594-4521-b1aa-405279b16ded 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58872eb1-d266-407b-9306-1cc98f5b082d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-964969a6-e7e5-4eb1-9801-96650834fe42', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:13 devstack sudo[88609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-41c9eddb-3594-4521-b1aa-405279b16ded 1073741824 Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8343aaa3-a5d1-4717-80c0-6a11c31c14cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:13 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:13 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Volume volume-964969a6-e7e5-4eb1-9801-96650834fe42 (964969a6-e7e5-4eb1-9801-96650834fe42): created successfully Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8343aaa3-a5d1-4717-80c0-6a11c31c14cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Flow 'volume_create_manager' (b1d741ab-d048-43b0-a75d-fc2e145cb576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:13 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-05f0028f-ece0-4e95-8018-4f84dd5282a8 tempest-VolumesActionsTest-1685731934 None] Created volume successfully. Feb 27 12:33:13 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0b38a550-7841-4631-9c2f-353603ad75f9 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fac4eca6-480b-4ac7-a595-0466524af2c0" returned: 0 in 0.425s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bacc987f-34a7-4024-ad76-f28e5769f25a tempest-ServersNegativeTestJSON-1710848624 None] Acquiring lock "cinder-5311a9a3-13d0-47cb-8af4-5a23f4498142-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-0b38a550-7841-4631-9c2f-353603ad75f9 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-quobyte-fac4eca6-480b-4ac7-a595-0466524af2c0" released by "delete_volume" :: held 1.053s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bacc987f-34a7-4024-ad76-f28e5769f25a tempest-ServersNegativeTestJSON-1710848624 None] Lock "cinder-5311a9a3-13d0-47cb-8af4-5a23f4498142-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bacc987f-34a7-4024-ad76-f28e5769f25a tempest-ServersNegativeTestJSON-1710848624 None] Acquiring lock "cinder-quobyte-5311a9a3-13d0-47cb-8af4-5a23f4498142" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bacc987f-34a7-4024-ad76-f28e5769f25a tempest-ServersNegativeTestJSON-1710848624 None] Lock "cinder-quobyte-5311a9a3-13d0-47cb-8af4-5a23f4498142" acquired by "delete_volume" :: waited 0.013s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-0b38a550-7841-4631-9c2f-353603ad75f9 tempest-CreateVolumesFromSnapshotTest-84566612 None] Created reservations ['a133bb5f-81cc-4b31-98ba-63d29a99619d', '94c6f8ea-1afd-4bfc-bad1-68dcafdc8508', 'f3883dda-dafc-497f-a56a-e75a38704ed7', '8c438f41-237f-4c04-819d-261707583066'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a9791e-7872-45ba-a5d5-c47c681790c8]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bacc987f-34a7-4024-ad76-f28e5769f25a tempest-ServersNegativeTestJSON-1710848624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5311a9a3-13d0-47cb-8af4-5a23f4498142 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0b38a550-7841-4631-9c2f-353603ad75f9 tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0b38a550-7841-4631-9c2f-353603ad75f9 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0b38a550-7841-4631-9c2f-353603ad75f9 tempest-CreateVolumesFromSnapshotTest-84566612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0b38a550-7841-4631-9c2f-353603ad75f9 tempest-CreateVolumesFromSnapshotTest-84566612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0b38a550-7841-4631-9c2f-353603ad75f9 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0b38a550-7841-4631-9c2f-353603ad75f9 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:13 devstack sudo[88613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:33:13 devstack sudo[88613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:13 devstack sudo[88612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5311a9a3-13d0-47cb-8af4-5a23f4498142 Feb 27 12:33:13 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:14 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-41c9eddb-3594-4521-b1aa-405279b16ded 1073741824" returned: 0 in 0.552s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-41c9eddb-3594-4521-b1aa-405279b16ded {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:14 devstack sudo[88619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-41c9eddb-3594-4521-b1aa-405279b16ded Feb 27 12:33:14 devstack sudo[88619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:14 devstack sudo[88613]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0b38a550-7841-4631-9c2f-353603ad75f9 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.474s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-0b38a550-7841-4631-9c2f-353603ad75f9 tempest-CreateVolumesFromSnapshotTest-84566612 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:14 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-0b38a550-7841-4631-9c2f-353603ad75f9 tempest-CreateVolumesFromSnapshotTest-84566612 None] Deleted volume successfully. Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-0b38a550-7841-4631-9c2f-353603ad75f9 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-fac4eca6-480b-4ac7-a595-0466524af2c0-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:14 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bacc987f-34a7-4024-ad76-f28e5769f25a tempest-ServersNegativeTestJSON-1710848624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5311a9a3-13d0-47cb-8af4-5a23f4498142" returned: 0 in 0.553s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bacc987f-34a7-4024-ad76-f28e5769f25a tempest-ServersNegativeTestJSON-1710848624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5311a9a3-13d0-47cb-8af4-5a23f4498142 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:14 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5311a9a3-13d0-47cb-8af4-5a23f4498142 Feb 27 12:33:14 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:14 devstack sudo[88619]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-41c9eddb-3594-4521-b1aa-405279b16ded" returned: 0 in 0.443s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd317d01-6bcd-4819-bf76-73ccd752e35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41c9eddb-3594-4521-b1aa-405279b16ded', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7410918-8650-4179-8d1f-d062f0926777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:14 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Volume volume-41c9eddb-3594-4521-b1aa-405279b16ded (41c9eddb-3594-4521-b1aa-405279b16ded): created successfully Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7410918-8650-4179-8d1f-d062f0926777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Flow 'volume_create_manager' (06c5e07e-0bd6-4c1d-912c-2f805a250b3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:14 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-b5c9b3d4-6f02-4e3f-b30c-e2f4c9c2d77a tempest-VolumesGetTest-1017574975 None] Created volume successfully. Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-29eea842-ee40-4718-a53f-d80c268a4507 tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "cinder-8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9-delete_snapshot" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:14 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-29eea842-ee40-4718-a53f-d80c268a4507 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-29eea842-ee40-4718-a53f-d80c268a4507 tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "cinder-quobyte-8640575c-1ec1-4b4b-920b-a27d381bae1d" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bacc987f-34a7-4024-ad76-f28e5769f25a tempest-ServersNegativeTestJSON-1710848624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5311a9a3-13d0-47cb-8af4-5a23f4498142" returned: 0 in 0.492s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-29eea842-ee40-4718-a53f-d80c268a4507 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-quobyte-8640575c-1ec1-4b4b-920b-a27d381bae1d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-29eea842-ee40-4718-a53f-d80c268a4507 tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "cinder-quobyte-8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bacc987f-34a7-4024-ad76-f28e5769f25a tempest-ServersNegativeTestJSON-1710848624 None] Lock "cinder-quobyte-5311a9a3-13d0-47cb-8af4-5a23f4498142" released by "delete_volume" :: held 1.082s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-29eea842-ee40-4718-a53f-d80c268a4507 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-quobyte-8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-29eea842-ee40-4718-a53f-d80c268a4507 tempest-CreateVolumesFromSnapshotTest-84566612 None] Deleting offline snapshot 8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9 of volume 8640575c-1ec1-4b4b-920b-a27d381bae1d {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-29eea842-ee40-4718-a53f-d80c268a4507 tempest-CreateVolumesFromSnapshotTest-84566612 None] snapshot_file for this snap is: volume-8640575c-1ec1-4b4b-920b-a27d381bae1d.8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8bf014-616e-4a99-b23f-f4e5dfe4e960]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-29eea842-ee40-4718-a53f-d80c268a4507 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d.8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-bacc987f-34a7-4024-ad76-f28e5769f25a tempest-ServersNegativeTestJSON-1710848624 None] Created reservations ['c75f2b80-db33-4fee-b9c1-c320d929477f', '3549f5d4-ddd0-4987-ac2a-e3384dd7496b', '6791db4b-2288-4735-88a3-1c0d97acde88', '3a199b76-ec9d-4bc8-9590-532cbe13993c'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:14 devstack sudo[88629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d.8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9 Feb 27 12:33:14 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bacc987f-34a7-4024-ad76-f28e5769f25a tempest-ServersNegativeTestJSON-1710848624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bacc987f-34a7-4024-ad76-f28e5769f25a tempest-ServersNegativeTestJSON-1710848624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bacc987f-34a7-4024-ad76-f28e5769f25a tempest-ServersNegativeTestJSON-1710848624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bacc987f-34a7-4024-ad76-f28e5769f25a tempest-ServersNegativeTestJSON-1710848624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bacc987f-34a7-4024-ad76-f28e5769f25a tempest-ServersNegativeTestJSON-1710848624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bacc987f-34a7-4024-ad76-f28e5769f25a tempest-ServersNegativeTestJSON-1710848624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:14 devstack sudo[88631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:33:14 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:14 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-81b0c704-36b6-4d7a-a07f-9410b6db126d tempest-VolumesActionsTest-1685731934 None] Acquiring lock "cinder-964969a6-e7e5-4eb1-9801-96650834fe42-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-81b0c704-36b6-4d7a-a07f-9410b6db126d tempest-VolumesActionsTest-1685731934 None] Lock "cinder-964969a6-e7e5-4eb1-9801-96650834fe42-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-666c5b75-bc4d-4a4f-a9f5-1cd06584a8f0 tempest-VolumesGetTest-1017574975 None] Acquiring lock "cinder-41c9eddb-3594-4521-b1aa-405279b16ded-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-81b0c704-36b6-4d7a-a07f-9410b6db126d tempest-VolumesActionsTest-1685731934 None] Acquiring lock "cinder-quobyte-964969a6-e7e5-4eb1-9801-96650834fe42" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-666c5b75-bc4d-4a4f-a9f5-1cd06584a8f0 tempest-VolumesGetTest-1017574975 None] Lock "cinder-41c9eddb-3594-4521-b1aa-405279b16ded-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-81b0c704-36b6-4d7a-a07f-9410b6db126d tempest-VolumesActionsTest-1685731934 None] Lock "cinder-quobyte-964969a6-e7e5-4eb1-9801-96650834fe42" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:15 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fb89d5-04f6-4845-bcc0-be1a6af71473]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-81b0c704-36b6-4d7a-a07f-9410b6db126d tempest-VolumesActionsTest-1685731934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-964969a6-e7e5-4eb1-9801-96650834fe42 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-666c5b75-bc4d-4a4f-a9f5-1cd06584a8f0 tempest-VolumesGetTest-1017574975 None] Acquiring lock "cinder-quobyte-41c9eddb-3594-4521-b1aa-405279b16ded" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-666c5b75-bc4d-4a4f-a9f5-1cd06584a8f0 tempest-VolumesGetTest-1017574975 None] Lock "cinder-quobyte-41c9eddb-3594-4521-b1aa-405279b16ded" acquired by "delete_volume" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:15 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9768e3-738c-4560-aa29-cff735acf6f6]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-666c5b75-bc4d-4a4f-a9f5-1cd06584a8f0 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-41c9eddb-3594-4521-b1aa-405279b16ded {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:15 devstack sudo[88633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-964969a6-e7e5-4eb1-9801-96650834fe42 Feb 27 12:33:15 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:15 devstack sudo[88634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-41c9eddb-3594-4521-b1aa-405279b16ded Feb 27 12:33:15 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:15 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bacc987f-34a7-4024-ad76-f28e5769f25a tempest-ServersNegativeTestJSON-1710848624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.460s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:15 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-bacc987f-34a7-4024-ad76-f28e5769f25a tempest-ServersNegativeTestJSON-1710848624 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:15 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:15 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-bacc987f-34a7-4024-ad76-f28e5769f25a tempest-ServersNegativeTestJSON-1710848624 None] Deleted volume successfully. Feb 27 12:33:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-29eea842-ee40-4718-a53f-d80c268a4507 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d.8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9" returned: 0 in 0.577s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-29eea842-ee40-4718-a53f-d80c268a4507 tempest-CreateVolumesFromSnapshotTest-84566612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8640575c-1ec1-4b4b-920b-a27d381bae1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:33:15 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dea5aa-aba1-4606-898e-f8801234c985]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-29eea842-ee40-4718-a53f-d80c268a4507 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bacc987f-34a7-4024-ad76-f28e5769f25a tempest-ServersNegativeTestJSON-1710848624 None] Lock "cinder-5311a9a3-13d0-47cb-8af4-5a23f4498142-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:15 devstack sudo[88641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d Feb 27 12:33:15 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:15 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-81b0c704-36b6-4d7a-a07f-9410b6db126d tempest-VolumesActionsTest-1685731934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-964969a6-e7e5-4eb1-9801-96650834fe42" returned: 0 in 0.524s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-81b0c704-36b6-4d7a-a07f-9410b6db126d tempest-VolumesActionsTest-1685731934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-964969a6-e7e5-4eb1-9801-96650834fe42 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:15 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-964969a6-e7e5-4eb1-9801-96650834fe42 Feb 27 12:33:15 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:15 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-666c5b75-bc4d-4a4f-a9f5-1cd06584a8f0 tempest-VolumesGetTest-1017574975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-41c9eddb-3594-4521-b1aa-405279b16ded" returned: 0 in 0.516s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-666c5b75-bc4d-4a4f-a9f5-1cd06584a8f0 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-41c9eddb-3594-4521-b1aa-405279b16ded {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:15 devstack sudo[88651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-41c9eddb-3594-4521-b1aa-405279b16ded Feb 27 12:33:15 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:16 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-29eea842-ee40-4718-a53f-d80c268a4507 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d" returned: 0 in 0.654s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-29eea842-ee40-4718-a53f-d80c268a4507 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d.8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:16 devstack sudo[88658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d.8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9 Feb 27 12:33:16 devstack sudo[88658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:16 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-81b0c704-36b6-4d7a-a07f-9410b6db126d tempest-VolumesActionsTest-1685731934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-964969a6-e7e5-4eb1-9801-96650834fe42" returned: 0 in 0.479s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-81b0c704-36b6-4d7a-a07f-9410b6db126d tempest-VolumesActionsTest-1685731934 None] Lock "cinder-quobyte-964969a6-e7e5-4eb1-9801-96650834fe42" released by "delete_volume" :: held 1.030s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-81b0c704-36b6-4d7a-a07f-9410b6db126d tempest-VolumesActionsTest-1685731934 None] Created reservations ['5ecd9d8c-775e-4c0a-aaa6-5b7e2c7f92e0', 'f6f61828-bfd7-43ec-b4a9-37550e3be551', '8339d5a8-248f-4f4e-9f5c-26dade9b7f79', '8d208d2e-e1bd-49e8-b4cc-cf8d48917cdb'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:16 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-666c5b75-bc4d-4a4f-a9f5-1cd06584a8f0 tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-41c9eddb-3594-4521-b1aa-405279b16ded" returned: 0 in 0.544s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-666c5b75-bc4d-4a4f-a9f5-1cd06584a8f0 tempest-VolumesGetTest-1017574975 None] Lock "cinder-quobyte-41c9eddb-3594-4521-b1aa-405279b16ded" released by "delete_volume" :: held 1.084s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-81b0c704-36b6-4d7a-a07f-9410b6db126d tempest-VolumesActionsTest-1685731934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-81b0c704-36b6-4d7a-a07f-9410b6db126d tempest-VolumesActionsTest-1685731934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-81b0c704-36b6-4d7a-a07f-9410b6db126d tempest-VolumesActionsTest-1685731934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-81b0c704-36b6-4d7a-a07f-9410b6db126d tempest-VolumesActionsTest-1685731934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-81b0c704-36b6-4d7a-a07f-9410b6db126d tempest-VolumesActionsTest-1685731934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-81b0c704-36b6-4d7a-a07f-9410b6db126d tempest-VolumesActionsTest-1685731934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:16 devstack sudo[88660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:33:16 devstack sudo[88660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-666c5b75-bc4d-4a4f-a9f5-1cd06584a8f0 tempest-VolumesGetTest-1017574975 None] Created reservations ['bb6544d3-54fc-40d3-98b4-6c8bef2c6e96', 'ebf2b3b6-ce99-44d5-baa7-9c3afbef9e6c', '45cdb17e-d4fa-43a0-8697-5e8e6039b15e', 'c4668da4-430c-4e7c-a021-1a25e1d9616f'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-666c5b75-bc4d-4a4f-a9f5-1cd06584a8f0 tempest-VolumesGetTest-1017574975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-666c5b75-bc4d-4a4f-a9f5-1cd06584a8f0 tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-666c5b75-bc4d-4a4f-a9f5-1cd06584a8f0 tempest-VolumesGetTest-1017574975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-666c5b75-bc4d-4a4f-a9f5-1cd06584a8f0 tempest-VolumesGetTest-1017574975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-666c5b75-bc4d-4a4f-a9f5-1cd06584a8f0 tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-666c5b75-bc4d-4a4f-a9f5-1cd06584a8f0 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:16 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:33:16 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:16 devstack sudo[88658]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-29eea842-ee40-4718-a53f-d80c268a4507 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d.8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9" returned: 0 in 0.528s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-29eea842-ee40-4718-a53f-d80c268a4507 tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d.8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:16 devstack sudo[88667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d.8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9 Feb 27 12:33:16 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:16 devstack sudo[88660]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-81b0c704-36b6-4d7a-a07f-9410b6db126d tempest-VolumesActionsTest-1685731934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.447s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-81b0c704-36b6-4d7a-a07f-9410b6db126d tempest-VolumesActionsTest-1685731934 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:16 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-81b0c704-36b6-4d7a-a07f-9410b6db126d tempest-VolumesActionsTest-1685731934 None] Deleted volume successfully. Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-81b0c704-36b6-4d7a-a07f-9410b6db126d tempest-VolumesActionsTest-1685731934 None] Lock "cinder-964969a6-e7e5-4eb1-9801-96650834fe42-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:16 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-666c5b75-bc4d-4a4f-a9f5-1cd06584a8f0 tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.414s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-666c5b75-bc4d-4a4f-a9f5-1cd06584a8f0 tempest-VolumesGetTest-1017574975 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:16 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-666c5b75-bc4d-4a4f-a9f5-1cd06584a8f0 tempest-VolumesGetTest-1017574975 None] Deleted volume successfully. Feb 27 12:33:16 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-666c5b75-bc4d-4a4f-a9f5-1cd06584a8f0 tempest-VolumesGetTest-1017574975 None] Lock "cinder-41c9eddb-3594-4521-b1aa-405279b16ded-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:17 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-29eea842-ee40-4718-a53f-d80c268a4507 tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d.8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9" returned: 0 in 0.530s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-29eea842-ee40-4718-a53f-d80c268a4507 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-quobyte-8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9" released by "_delete_snapshot" :: held 2.352s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-29eea842-ee40-4718-a53f-d80c268a4507 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-quobyte-8640575c-1ec1-4b4b-920b-a27d381bae1d" released by "delete_snapshot" :: held 2.372s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:17 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-29eea842-ee40-4718-a53f-d80c268a4507 tempest-CreateVolumesFromSnapshotTest-84566612 None] Created reservations ['07056064-57fd-4d41-9569-c15c3f9341b4', 'e264780a-5056-48a7-aa0b-8bc0b90d7224', 'f9d8a7ab-d0ce-4174-bdd0-25e5ba73ff80', 'b9af36d3-0fdd-450a-a855-96d8d50a1071'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:17 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-29eea842-ee40-4718-a53f-d80c268a4507 tempest-CreateVolumesFromSnapshotTest-84566612 None] Delete snapshot completed successfully. Feb 27 12:33:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-29eea842-ee40-4718-a53f-d80c268a4507 tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-8a5ec71a-e2c0-4b0f-bb34-8108b4a451e9-delete_snapshot" released by "delete_snapshot" :: held 2.500s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4ba06243-2f59-4b32-bebd-134e5e640ad3 tempest-VolumesGetTest-1017574975 None] Acquiring lock "cinder-6cde1383-0251-4bca-9000-5d19ec50de9c-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4ba06243-2f59-4b32-bebd-134e5e640ad3 tempest-VolumesGetTest-1017574975 None] Lock "cinder-6cde1383-0251-4bca-9000-5d19ec50de9c-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4ba06243-2f59-4b32-bebd-134e5e640ad3 tempest-VolumesGetTest-1017574975 None] Acquiring lock "cinder-quobyte-6cde1383-0251-4bca-9000-5d19ec50de9c" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4ba06243-2f59-4b32-bebd-134e5e640ad3 tempest-VolumesGetTest-1017574975 None] Lock "cinder-quobyte-6cde1383-0251-4bca-9000-5d19ec50de9c" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:17 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab33a08-e008-4d12-b7bc-62bfc2070995]: (4, 'raw') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4ba06243-2f59-4b32-bebd-134e5e640ad3 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:17 devstack sudo[88694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c Feb 27 12:33:17 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-43453cd9-74ad-4622-a9cc-4d3428c3b53b tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "cinder-8640575c-1ec1-4b4b-920b-a27d381bae1d-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-43453cd9-74ad-4622-a9cc-4d3428c3b53b tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-8640575c-1ec1-4b4b-920b-a27d381bae1d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:17 devstack cinder-volume[83077]: DEBUG dbcounter [-] [83077] Writing DB stats cinder:SELECT=198,cinder:INSERT=73,cinder:UPDATE=284,cinder:DELETE=28 {{(pid=83077) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:33:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-43453cd9-74ad-4622-a9cc-4d3428c3b53b tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "cinder-quobyte-8640575c-1ec1-4b4b-920b-a27d381bae1d" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-43453cd9-74ad-4622-a9cc-4d3428c3b53b tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-quobyte-8640575c-1ec1-4b4b-920b-a27d381bae1d" acquired by "delete_volume" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:17 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8d9fa8-4e67-4e90-afec-30df56c5d122]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-43453cd9-74ad-4622-a9cc-4d3428c3b53b tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:18 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4ba06243-2f59-4b32-bebd-134e5e640ad3 tempest-VolumesGetTest-1017574975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c" returned: 0 in 0.597s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4ba06243-2f59-4b32-bebd-134e5e640ad3 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:18 devstack sudo[88699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d Feb 27 12:33:18 devstack sudo[88699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:18 devstack sudo[88700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c Feb 27 12:33:18 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:18 devstack sudo[88699]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-43453cd9-74ad-4622-a9cc-4d3428c3b53b tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d" returned: 0 in 0.676s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-43453cd9-74ad-4622-a9cc-4d3428c3b53b tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:18 devstack sudo[88710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d Feb 27 12:33:18 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:18 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4ba06243-2f59-4b32-bebd-134e5e640ad3 tempest-VolumesGetTest-1017574975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c" returned: 1 in 0.726s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4ba06243-2f59-4b32-bebd-134e5e640ad3 tempest-VolumesGetTest-1017574975 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c' failed. Not Retrying. {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:33:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4ba06243-2f59-4b32-bebd-134e5e640ad3 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:18 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c Feb 27 12:33:18 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:19 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-43453cd9-74ad-4622-a9cc-4d3428c3b53b tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8640575c-1ec1-4b4b-920b-a27d381bae1d" returned: 0 in 0.452s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:19 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-43453cd9-74ad-4622-a9cc-4d3428c3b53b tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-quobyte-8640575c-1ec1-4b4b-920b-a27d381bae1d" released by "delete_volume" :: held 1.181s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:19 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-43453cd9-74ad-4622-a9cc-4d3428c3b53b tempest-CreateVolumesFromSnapshotTest-84566612 None] Created reservations ['587a2d83-fa86-4773-8f95-5e17880b9d48', '9405586b-33a6-41eb-af5a-07bd3002d2f9', '21211421-c684-4c24-93de-cf4a420124b9', '90bf3ac7-084b-42dd-aac9-a000e5f5868b'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-43453cd9-74ad-4622-a9cc-4d3428c3b53b tempest-CreateVolumesFromSnapshotTest-84566612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-43453cd9-74ad-4622-a9cc-4d3428c3b53b tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-43453cd9-74ad-4622-a9cc-4d3428c3b53b tempest-CreateVolumesFromSnapshotTest-84566612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-43453cd9-74ad-4622-a9cc-4d3428c3b53b tempest-CreateVolumesFromSnapshotTest-84566612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-43453cd9-74ad-4622-a9cc-4d3428c3b53b tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-43453cd9-74ad-4622-a9cc-4d3428c3b53b tempest-CreateVolumesFromSnapshotTest-84566612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:19 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:33:19 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:19 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4ba06243-2f59-4b32-bebd-134e5e640ad3 tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6cde1383-0251-4bca-9000-5d19ec50de9c" returned: 0 in 0.527s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:19 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4ba06243-2f59-4b32-bebd-134e5e640ad3 tempest-VolumesGetTest-1017574975 None] Lock "cinder-quobyte-6cde1383-0251-4bca-9000-5d19ec50de9c" released by "delete_volume" :: held 1.901s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:19 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-4ba06243-2f59-4b32-bebd-134e5e640ad3 tempest-VolumesGetTest-1017574975 None] Created reservations ['997c07f2-8fbe-467e-a406-d3a1b2940577', 'd69b22e1-7933-49b8-b196-6dd5e584d6d1', '50530b8b-f605-43eb-a7b0-f55ffad30a4a', '2aff98f3-e54e-4f61-806c-8ba4cdacbabf'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-4ba06243-2f59-4b32-bebd-134e5e640ad3 tempest-VolumesGetTest-1017574975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-4ba06243-2f59-4b32-bebd-134e5e640ad3 tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-4ba06243-2f59-4b32-bebd-134e5e640ad3 tempest-VolumesGetTest-1017574975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-4ba06243-2f59-4b32-bebd-134e5e640ad3 tempest-VolumesGetTest-1017574975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-4ba06243-2f59-4b32-bebd-134e5e640ad3 tempest-VolumesGetTest-1017574975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4ba06243-2f59-4b32-bebd-134e5e640ad3 tempest-VolumesGetTest-1017574975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:19 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:33:19 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:19 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-43453cd9-74ad-4622-a9cc-4d3428c3b53b tempest-CreateVolumesFromSnapshotTest-84566612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.503s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:19 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-43453cd9-74ad-4622-a9cc-4d3428c3b53b tempest-CreateVolumesFromSnapshotTest-84566612 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:19 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-43453cd9-74ad-4622-a9cc-4d3428c3b53b tempest-CreateVolumesFromSnapshotTest-84566612 None] Deleted volume successfully. Feb 27 12:33:19 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-43453cd9-74ad-4622-a9cc-4d3428c3b53b tempest-CreateVolumesFromSnapshotTest-84566612 None] Lock "cinder-8640575c-1ec1-4b4b-920b-a27d381bae1d-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:19 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4ba06243-2f59-4b32-bebd-134e5e640ad3 tempest-VolumesGetTest-1017574975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.596s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:19 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-4ba06243-2f59-4b32-bebd-134e5e640ad3 tempest-VolumesGetTest-1017574975 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:19 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-4ba06243-2f59-4b32-bebd-134e5e640ad3 tempest-VolumesGetTest-1017574975 None] Deleted volume successfully. Feb 27 12:33:20 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4ba06243-2f59-4b32-bebd-134e5e640ad3 tempest-VolumesGetTest-1017574975 None] Lock "cinder-6cde1383-0251-4bca-9000-5d19ec50de9c-delete_volume" released by "delete_volume" :: held 2.639s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:22 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:33:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Flow 'volume_create_manager' (297798cd-5f76-440a-a85c-49addb8abd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (142b417e-4bd4-4610-b44d-62c593bf3bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (142b417e-4bd4-4610-b44d-62c593bf3bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-595050714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd7629b-8400-4fec-9abc-49c7e882c998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883d8562c6ea43a2ae62fd75d56cdd22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:22Z,use_quota=True,user_id='2aa53330b8eb4278970b104936ca1155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2706d31a-3d0b-49ee-9020-4a05d12ae26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2706d31a-3d0b-49ee-9020-4a05d12ae26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be6d879-7bd0-4968-b9d0-586d3d74fd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be6d879-7bd0-4968-b9d0-586d3d74fd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fd7629b-8400-4fec-9abc-49c7e882c998', 'volume_name': 'volume-6fd7629b-8400-4fec-9abc-49c7e882c998', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12b0bc7e-4394-489e-873b-d7a9bcb7f774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12b0bc7e-4394-489e-873b-d7a9bcb7f774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd67ac58-7315-41ea-98eb-28e101c5c307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:22 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Volume 6fd7629b-8400-4fec-9abc-49c7e882c998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fd7629b-8400-4fec-9abc-49c7e882c998', 'volume_size': 1} Feb 27 12:33:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-595050714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd7629b-8400-4fec-9abc-49c7e882c998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883d8562c6ea43a2ae62fd75d56cdd22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:22Z,use_quota=True,user_id='2aa53330b8eb4278970b104936ca1155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Creating volume 6fd7629b-8400-4fec-9abc-49c7e882c998 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:22 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:33:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6fd7629b-8400-4fec-9abc-49c7e882c998 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:22 devstack sudo[88727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6fd7629b-8400-4fec-9abc-49c7e882c998 1073741824 Feb 27 12:33:22 devstack sudo[88727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:22 devstack sudo[88727]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6fd7629b-8400-4fec-9abc-49c7e882c998 1073741824" returned: 0 in 0.605s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6fd7629b-8400-4fec-9abc-49c7e882c998 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:22 devstack sudo[88732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6fd7629b-8400-4fec-9abc-49c7e882c998 Feb 27 12:33:22 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:23 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6fd7629b-8400-4fec-9abc-49c7e882c998" returned: 0 in 0.564s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:23 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:23 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd67ac58-7315-41ea-98eb-28e101c5c307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fd7629b-8400-4fec-9abc-49c7e882c998', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:23 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6fdc80-45bd-4edf-be8d-7b27999733e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:23 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Volume volume-6fd7629b-8400-4fec-9abc-49c7e882c998 (6fd7629b-8400-4fec-9abc-49c7e882c998): created successfully Feb 27 12:33:23 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6fdc80-45bd-4edf-be8d-7b27999733e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:23 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Flow 'volume_create_manager' (297798cd-5f76-440a-a85c-49addb8abd01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:23 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-d83a8230-25e9-41ea-98a0-952c194d9288 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Created volume successfully. Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Flow 'volume_create_manager' (6f1bf697-eaa7-4554-8f94-88ae8416921d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec2c0af-59cc-489b-bab6-9eef86d2b117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec2c0af-59cc-489b-bab6-9eef86d2b117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1312484867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e86d49-7d3b-4b31-a692-daef01cb1f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883d8562c6ea43a2ae62fd75d56cdd22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:25Z,use_quota=True,user_id='2aa53330b8eb4278970b104936ca1155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c489b0-ff32-4277-a88e-3dea90c2b00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c489b0-ff32-4277-a88e-3dea90c2b00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6afeaec5-7fd2-45ed-bc62-4a7cd7b1eb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6afeaec5-7fd2-45ed-bc62-4a7cd7b1eb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4e86d49-7d3b-4b31-a692-daef01cb1f05', 'volume_name': 'volume-b4e86d49-7d3b-4b31-a692-daef01cb1f05', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1785fc2-de39-48ef-9d92-01876ca5626e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1785fc2-de39-48ef-9d92-01876ca5626e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e484c917-0e81-4e96-88f6-884751c6377c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:24 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Volume b4e86d49-7d3b-4b31-a692-daef01cb1f05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4e86d49-7d3b-4b31-a692-daef01cb1f05', 'volume_size': 1} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1312484867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e86d49-7d3b-4b31-a692-daef01cb1f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883d8562c6ea43a2ae62fd75d56cdd22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:25Z,use_quota=True,user_id='2aa53330b8eb4278970b104936ca1155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Creating volume b4e86d49-7d3b-4b31-a692-daef01cb1f05 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:24 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b4e86d49-7d3b-4b31-a692-daef01cb1f05 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:24 devstack sudo[88737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b4e86d49-7d3b-4b31-a692-daef01cb1f05 1073741824 Feb 27 12:33:24 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Flow 'volume_create_manager' (187f2a3e-5f47-4e09-a5ff-00f43e757d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7c5ecb9-02fb-4272-9afe-c5acd1a77917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7c5ecb9-02fb-4272-9afe-c5acd1a77917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1600967575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66fb1f3e-ad5e-4edd-9c60-71625d87db7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883d8562c6ea43a2ae62fd75d56cdd22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:25Z,use_quota=True,user_id='2aa53330b8eb4278970b104936ca1155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6efd3d81-4a97-41e0-a671-0d883966127d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6efd3d81-4a97-41e0-a671-0d883966127d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16878bdf-f854-4d63-989b-998635a9a6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16878bdf-f854-4d63-989b-998635a9a6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66fb1f3e-ad5e-4edd-9c60-71625d87db7a', 'volume_name': 'volume-66fb1f3e-ad5e-4edd-9c60-71625d87db7a', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1210e51e-8669-41b4-acc6-cd4b93a905dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1210e51e-8669-41b4-acc6-cd4b93a905dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ce09ee-08d4-4de1-b502-bf4e274c55cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:24 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Volume 66fb1f3e-ad5e-4edd-9c60-71625d87db7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66fb1f3e-ad5e-4edd-9c60-71625d87db7a', 'volume_size': 1} Feb 27 12:33:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Flow 'volume_create_manager' (0215a35a-6761-486d-91a4-6a7ad38d1ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092a5850-c5dc-4fb6-bb26-2db03dd141d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092a5850-c5dc-4fb6-bb26-2db03dd141d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1174758321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0475ab16-a94e-4a64-90f2-379f01f66332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883d8562c6ea43a2ae62fd75d56cdd22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:25Z,use_quota=True,user_id='2aa53330b8eb4278970b104936ca1155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19881582-94a8-443b-94ac-3197f11127a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19881582-94a8-443b-94ac-3197f11127a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de52f9ed-e28a-4fb1-9c06-f1d532ae87dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de52f9ed-e28a-4fb1-9c06-f1d532ae87dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0475ab16-a94e-4a64-90f2-379f01f66332', 'volume_name': 'volume-0475ab16-a94e-4a64-90f2-379f01f66332', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f31479df-dab9-4385-9df5-e0cbbbd391ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f31479df-dab9-4385-9df5-e0cbbbd391ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb8da8f-c0cb-4b0e-8f63-b15395b523a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:25 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Volume 0475ab16-a94e-4a64-90f2-379f01f66332: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0475ab16-a94e-4a64-90f2-379f01f66332', 'volume_size': 1} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Flow 'volume_create_manager' (9259362b-6000-4285-8773-f9d3799b03d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06766817-b7c0-4371-ba76-4a7bdf92e953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06766817-b7c0-4371-ba76-4a7bdf92e953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1074780041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f2b12c-f074-4e71-a355-5f07e4731332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883d8562c6ea43a2ae62fd75d56cdd22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:25Z,use_quota=True,user_id='2aa53330b8eb4278970b104936ca1155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a5a4c7-87c8-49d5-b588-d8e916cf478d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a5a4c7-87c8-49d5-b588-d8e916cf478d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208ee0ad-14b5-4820-b140-34b9076a54ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208ee0ad-14b5-4820-b140-34b9076a54ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0f2b12c-f074-4e71-a355-5f07e4731332', 'volume_name': 'volume-f0f2b12c-f074-4e71-a355-5f07e4731332', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4b1447-fbb7-4f56-8615-602613aed35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4b1447-fbb7-4f56-8615-602613aed35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f5f31c-f85b-4a36-80ee-7c2bc28c13bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:25 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Volume f0f2b12c-f074-4e71-a355-5f07e4731332: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0f2b12c-f074-4e71-a355-5f07e4731332', 'volume_size': 1} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:25 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b4e86d49-7d3b-4b31-a692-daef01cb1f05 1073741824" returned: 0 in 0.865s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b4e86d49-7d3b-4b31-a692-daef01cb1f05 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:25 devstack sudo[88742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b4e86d49-7d3b-4b31-a692-daef01cb1f05 Feb 27 12:33:25 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Flow 'volume_create_manager' (d00f52f4-778f-4e81-8ed4-3eb566895ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d92863-b44e-41ef-be8b-e7631a2cada3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d92863-b44e-41ef-be8b-e7631a2cada3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1538584449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea8e571-cb91-47ae-95c4-92bde234b2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883d8562c6ea43a2ae62fd75d56cdd22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:26Z,use_quota=True,user_id='2aa53330b8eb4278970b104936ca1155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c36e123-7ddd-4df1-8f9f-ecbfe2fbcd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c36e123-7ddd-4df1-8f9f-ecbfe2fbcd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef1792d-a885-46b1-b69b-7f8d037318b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef1792d-a885-46b1-b69b-7f8d037318b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eea8e571-cb91-47ae-95c4-92bde234b2fe', 'volume_name': 'volume-eea8e571-cb91-47ae-95c4-92bde234b2fe', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91dd95e6-3600-45bb-bd7f-91e6d66a0507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91dd95e6-3600-45bb-bd7f-91e6d66a0507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a9a332-b9b5-48bc-a535-3bb29b8d99cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:25 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Volume eea8e571-cb91-47ae-95c4-92bde234b2fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eea8e571-cb91-47ae-95c4-92bde234b2fe', 'volume_size': 1} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Flow 'volume_create_manager' (fcf2dd82-9684-4c3b-b7e8-ad25efd85be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4252af1a-8638-42b4-a658-f310f2acb401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4252af1a-8638-42b4-a658-f310f2acb401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1312034062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2e2cab5-6a95-4a7e-af74-c6d9d2395313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f0237c2c7ce4e8187e0be24b61457bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:26Z,use_quota=True,user_id='11ce73168089450f82d1646adc780909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d35df14-bdbb-49b2-b6a5-6c27d03d3432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d35df14-bdbb-49b2-b6a5-6c27d03d3432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c36250-89d9-444b-a1af-d32f98addcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:25 devstack cinder-volume[83077]: DEBUG cinder.image.glance [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Creating Keystone auth plugin from conf {{(pid=83077) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c36250-89d9-444b-a1af-d32f98addcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e2e2cab5-6a95-4a7e-af74-c6d9d2395313', 'volume_name': 'volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313', 'volume_size': 1, 'image_id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c0a1769-4e00-41fd-a047-783ef98efe34', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa6a7971cf2a477f87f22a9fc435f45d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'created_at': datetime.datetime(2026, 2, 27, 11, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 11, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c0a1769-4e00-41fd-a047-783ef98efe34/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd4eca6-90b4-44d6-9543-3d07048c3c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd4eca6-90b4-44d6-9543-3d07048c3c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34baf5f9-f89b-446e-a895-dbe17cb82afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:26 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Volume e2e2cab5-6a95-4a7e-af74-c6d9d2395313: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313', 'volume_size': 1, 'image_id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c0a1769-4e00-41fd-a047-783ef98efe34', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa6a7971cf2a477f87f22a9fc435f45d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'created_at': datetime.datetime(2026, 2, 27, 11, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 11, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c0a1769-4e00-41fd-a047-783ef98efe34/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Trying to clone e2e2cab5-6a95-4a7e-af74-c6d9d2395313 from image 9c0a1769-4e00-41fd-a047-783ef98efe34 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9c0a1769-4e00-41fd-a047-783ef98efe34', 'metadata': {}}]). {{(pid=83077) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 12:33:26 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b4e86d49-7d3b-4b31-a692-daef01cb1f05" returned: 0 in 0.517s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.230s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1600967575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66fb1f3e-ad5e-4edd-9c60-71625d87db7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883d8562c6ea43a2ae62fd75d56cdd22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:25Z,use_quota=True,user_id='2aa53330b8eb4278970b104936ca1155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Creating volume 66fb1f3e-ad5e-4edd-9c60-71625d87db7a {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:26 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-66fb1f3e-ad5e-4edd-9c60-71625d87db7a 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:26 devstack sudo[88745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-66fb1f3e-ad5e-4edd-9c60-71625d87db7a 1073741824 Feb 27 12:33:26 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e484c917-0e81-4e96-88f6-884751c6377c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4e86d49-7d3b-4b31-a692-daef01cb1f05', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c860f69-94b0-4a0a-87d5-c8fc38ba8ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:26 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Volume volume-b4e86d49-7d3b-4b31-a692-daef01cb1f05 (b4e86d49-7d3b-4b31-a692-daef01cb1f05): created successfully Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c860f69-94b0-4a0a-87d5-c8fc38ba8ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Flow 'volume_create_manager' (6f1bf697-eaa7-4554-8f94-88ae8416921d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:26 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-e3c4a7c5-6aaa-4ed3-8e88-175e18ed4ddf tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Created volume successfully. Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_r0edcuc4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83077) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 12:33:26 devstack cinder-volume[83077]: INFO cinder.image.image_utils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Image download 20.69 MB at 20.69 MB/s Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe428a99-a2d1-4e3d-813e-201a31d4439a]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_r0edcuc4devstack@QuobyteHD {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:26 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_r0edcuc4devstack@QuobyteHD Feb 27 12:33:26 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:26 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-66fb1f3e-ad5e-4edd-9c60-71625d87db7a 1073741824" returned: 0 in 0.681s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-66fb1f3e-ad5e-4edd-9c60-71625d87db7a {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:26 devstack sudo[88763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-66fb1f3e-ad5e-4edd-9c60-71625d87db7a Feb 27 12:33:26 devstack sudo[88763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:26 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_r0edcuc4devstack@QuobyteHD" returned: 0 in 0.571s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:26 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Temporary image 9c0a1769-4e00-41fd-a047-783ef98efe34 is fetched for user 11ce73168089450f82d1646adc780909. {{(pid=83077) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 12:33:27 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b7395a-1737-4cf8-9a55-a49b41bd7638]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_r0edcuc4devstack@QuobyteHD {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:27 devstack sudo[88777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_r0edcuc4devstack@QuobyteHD Feb 27 12:33:27 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:27 devstack sudo[88763]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-66fb1f3e-ad5e-4edd-9c60-71625d87db7a" returned: 0 in 0.479s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.226s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1174758321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0475ab16-a94e-4a64-90f2-379f01f66332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883d8562c6ea43a2ae62fd75d56cdd22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:25Z,use_quota=True,user_id='2aa53330b8eb4278970b104936ca1155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Creating volume 0475ab16-a94e-4a64-90f2-379f01f66332 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:27 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:33:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-0475ab16-a94e-4a64-90f2-379f01f66332 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:27 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ce09ee-08d4-4de1-b502-bf4e274c55cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66fb1f3e-ad5e-4edd-9c60-71625d87db7a', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:27 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f16b84e6-775b-4c7f-bc1c-2abb6bfc20ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:27 devstack sudo[88802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-0475ab16-a94e-4a64-90f2-379f01f66332 1073741824 Feb 27 12:33:27 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:27 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Volume volume-66fb1f3e-ad5e-4edd-9c60-71625d87db7a (66fb1f3e-ad5e-4edd-9c60-71625d87db7a): created successfully Feb 27 12:33:27 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f16b84e6-775b-4c7f-bc1c-2abb6bfc20ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:27 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Flow 'volume_create_manager' (187f2a3e-5f47-4e09-a5ff-00f43e757d97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:27 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-dfeafd2a-6d93-4aa7-a636-3d299d9481ed tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Created volume successfully. Feb 27 12:33:27 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_r0edcuc4devstack@QuobyteHD" returned: 0 in 0.671s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:28 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-0475ab16-a94e-4a64-90f2-379f01f66332 1073741824" returned: 0 in 0.643s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-0475ab16-a94e-4a64-90f2-379f01f66332 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:28 devstack sudo[88810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-0475ab16-a94e-4a64-90f2-379f01f66332 Feb 27 12:33:28 devstack sudo[88810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:28 devstack sudo[88810]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-0475ab16-a94e-4a64-90f2-379f01f66332" returned: 0 in 0.470s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.126s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1074780041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f2b12c-f074-4e71-a355-5f07e4731332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883d8562c6ea43a2ae62fd75d56cdd22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:25Z,use_quota=True,user_id='2aa53330b8eb4278970b104936ca1155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Creating volume f0f2b12c-f074-4e71-a355-5f07e4731332 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:28 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f0f2b12c-f074-4e71-a355-5f07e4731332 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb8da8f-c0cb-4b0e-8f63-b15395b523a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0475ab16-a94e-4a64-90f2-379f01f66332', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:28 devstack sudo[88813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f0f2b12c-f074-4e71-a355-5f07e4731332 1073741824 Feb 27 12:33:28 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed57c5d8-568b-42d7-b2bb-d72010808ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:28 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Volume volume-0475ab16-a94e-4a64-90f2-379f01f66332 (0475ab16-a94e-4a64-90f2-379f01f66332): created successfully Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed57c5d8-568b-42d7-b2bb-d72010808ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Flow 'volume_create_manager' (0215a35a-6761-486d-91a4-6a7ad38d1ffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:28 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-80e49dec-e4bd-4722-80f1-0d2d72cd4fea tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Created volume successfully. Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Flow 'volume_create_manager' (928b1725-6fc2-47aa-a2bd-6b1d7aa73e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b06323-84d0-4465-a3a9-b7c408bbd70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b06323-84d0-4465-a3a9-b7c408bbd70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1527230789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d977b12-14ee-479c-b091-9753a273c6c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51582721ab9145f98c95db9f71f2ae30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:29Z,use_quota=True,user_id='6b3d508980da40e98940197849a26efb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (961a37da-7593-4fe8-bf46-414c06052c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (961a37da-7593-4fe8-bf46-414c06052c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88db079-ac84-404e-91e7-300a38109041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88db079-ac84-404e-91e7-300a38109041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d977b12-14ee-479c-b091-9753a273c6c6', 'volume_name': 'volume-7d977b12-14ee-479c-b091-9753a273c6c6', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1888c3d-fec3-4397-ad20-6f7bd6c4128c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1888c3d-fec3-4397-ad20-6f7bd6c4128c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f31e38a-2358-4941-ad61-0051e314bb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:28 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Volume 7d977b12-14ee-479c-b091-9753a273c6c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d977b12-14ee-479c-b091-9753a273c6c6', 'volume_size': 1} Feb 27 12:33:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:29 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f0f2b12c-f074-4e71-a355-5f07e4731332 1073741824" returned: 0 in 0.538s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f0f2b12c-f074-4e71-a355-5f07e4731332 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:29 devstack sudo[88818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f0f2b12c-f074-4e71-a355-5f07e4731332 Feb 27 12:33:29 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:29 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f0f2b12c-f074-4e71-a355-5f07e4731332" returned: 0 in 0.440s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:29 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.795s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:29 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1538584449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea8e571-cb91-47ae-95c4-92bde234b2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883d8562c6ea43a2ae62fd75d56cdd22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:26Z,use_quota=True,user_id='2aa53330b8eb4278970b104936ca1155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:29 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Creating volume eea8e571-cb91-47ae-95c4-92bde234b2fe {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:29 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:29 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:29 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:29 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:33:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea8e571-cb91-47ae-95c4-92bde234b2fe 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:29 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f5f31c-f85b-4a36-80ee-7c2bc28c13bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0f2b12c-f074-4e71-a355-5f07e4731332', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:29 devstack sudo[88821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea8e571-cb91-47ae-95c4-92bde234b2fe 1073741824 Feb 27 12:33:29 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:29 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30be8219-676f-4195-b862-524f2b5347cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:29 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Volume volume-f0f2b12c-f074-4e71-a355-5f07e4731332 (f0f2b12c-f074-4e71-a355-5f07e4731332): created successfully Feb 27 12:33:29 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30be8219-676f-4195-b862-524f2b5347cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:29 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Flow 'volume_create_manager' (9259362b-6000-4285-8773-f9d3799b03d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:29 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-bab693e8-5607-45b9-9c99-2aee6614f4bb tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Created volume successfully. Feb 27 12:33:30 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea8e571-cb91-47ae-95c4-92bde234b2fe 1073741824" returned: 0 in 0.544s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea8e571-cb91-47ae-95c4-92bde234b2fe {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:30 devstack sudo[88826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea8e571-cb91-47ae-95c4-92bde234b2fe Feb 27 12:33:30 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:30 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea8e571-cb91-47ae-95c4-92bde234b2fe" returned: 0 in 0.465s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:30 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.871s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:30 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1312034062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2e2cab5-6a95-4a7e-af74-c6d9d2395313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f0237c2c7ce4e8187e0be24b61457bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:26Z,use_quota=True,user_id='11ce73168089450f82d1646adc780909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:30 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Creating volume e2e2cab5-6a95-4a7e-af74-c6d9d2395313 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:30 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:30 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:30 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:30 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:33:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:30 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a9a332-b9b5-48bc-a535-3bb29b8d99cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eea8e571-cb91-47ae-95c4-92bde234b2fe', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:30 devstack sudo[88829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313 1073741824 Feb 27 12:33:30 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:30 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b96b4ad-29ba-4c18-8343-233ee295e45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:30 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Volume volume-eea8e571-cb91-47ae-95c4-92bde234b2fe (eea8e571-cb91-47ae-95c4-92bde234b2fe): created successfully Feb 27 12:33:30 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b96b4ad-29ba-4c18-8343-233ee295e45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:30 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Flow 'volume_create_manager' (d00f52f4-778f-4e81-8ed4-3eb566895ff9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:30 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-f2ce5a32-6a69-44e7-849a-bc3930c74df7 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Created volume successfully. Feb 27 12:33:31 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313 1073741824" returned: 0 in 0.582s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-136584f2-b004-4fcb-bf2c-ed81152ec586 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "cinder-eea8e571-cb91-47ae-95c4-92bde234b2fe-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:31 devstack sudo[88835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313 Feb 27 12:33:31 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-136584f2-b004-4fcb-bf2c-ed81152ec586 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "cinder-eea8e571-cb91-47ae-95c4-92bde234b2fe-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-136584f2-b004-4fcb-bf2c-ed81152ec586 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "cinder-quobyte-eea8e571-cb91-47ae-95c4-92bde234b2fe" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-136584f2-b004-4fcb-bf2c-ed81152ec586 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "cinder-quobyte-eea8e571-cb91-47ae-95c4-92bde234b2fe" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:31 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0e1770-bac1-487d-8f3d-0b80d53a9243]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-136584f2-b004-4fcb-bf2c-ed81152ec586 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea8e571-cb91-47ae-95c4-92bde234b2fe {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:31 devstack sudo[88837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea8e571-cb91-47ae-95c4-92bde234b2fe Feb 27 12:33:31 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:31 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313" returned: 0 in 0.488s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:31 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.861s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:31 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1527230789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d977b12-14ee-479c-b091-9753a273c6c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51582721ab9145f98c95db9f71f2ae30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:29Z,use_quota=True,user_id='6b3d508980da40e98940197849a26efb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:31 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Creating volume 7d977b12-14ee-479c-b091-9753a273c6c6 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:31 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:31 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:31 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:31 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:33:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:31 devstack sudo[88843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6 1073741824 Feb 27 12:33:31 devstack sudo[88843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:31 devstack cinder-volume[83077]: DEBUG cinder.volume.volume_utils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Attempting download of 9c0a1769-4e00-41fd-a047-783ef98efe34 ((None, [{'url': 'file:///opt/stack/data/glance/images/9c0a1769-4e00-41fd-a047-783ef98efe34', 'metadata': {}}])) to volume e2e2cab5-6a95-4a7e-af74-c6d9d2395313. {{(pid=83077) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 12:33:31 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ae2eba-4d46-4012-aa09-b719c2aac77f]: (4, 'raw') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_7s_d242f {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:31 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-136584f2-b004-4fcb-bf2c-ed81152ec586 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea8e571-cb91-47ae-95c4-92bde234b2fe" returned: 0 in 0.525s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-136584f2-b004-4fcb-bf2c-ed81152ec586 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea8e571-cb91-47ae-95c4-92bde234b2fe {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:31 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea8e571-cb91-47ae-95c4-92bde234b2fe Feb 27 12:33:31 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:31 devstack sudo[88845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_7s_d242f Feb 27 12:33:31 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:32 devstack sudo[88843]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6 1073741824" returned: 0 in 0.569s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:32 devstack sudo[88855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6 Feb 27 12:33:32 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:32 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:32 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_7s_d242f" returned: 0 in 0.553s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_7s_d242f {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-136584f2-b004-4fcb-bf2c-ed81152ec586 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea8e571-cb91-47ae-95c4-92bde234b2fe" returned: 0 in 0.532s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:32 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-136584f2-b004-4fcb-bf2c-ed81152ec586 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "cinder-quobyte-eea8e571-cb91-47ae-95c4-92bde234b2fe" released by "delete_volume" :: held 1.082s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:32 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-136584f2-b004-4fcb-bf2c-ed81152ec586 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Created reservations ['e718738d-a877-41d0-bc7f-f5bef6f6e9eb', 'f1948706-270b-4117-b335-037fc4f7f260', '3cada15c-1328-4f1c-b463-c6ee9c8fd706', 'da4e91fa-9dec-4497-9db3-ec141bb89917'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-136584f2-b004-4fcb-bf2c-ed81152ec586 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-136584f2-b004-4fcb-bf2c-ed81152ec586 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:32 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-136584f2-b004-4fcb-bf2c-ed81152ec586 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:32 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_7s_d242f Feb 27 12:33:32 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:32 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-136584f2-b004-4fcb-bf2c-ed81152ec586 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-136584f2-b004-4fcb-bf2c-ed81152ec586 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-136584f2-b004-4fcb-bf2c-ed81152ec586 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:32 devstack sudo[88859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:33:32 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:32 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6" returned: 0 in 0.434s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:32 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f31e38a-2358-4941-ad61-0051e314bb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d977b12-14ee-479c-b091-9753a273c6c6', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc26ebc-d189-41aa-9fcd-820b42b510b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:32 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Volume volume-7d977b12-14ee-479c-b091-9753a273c6c6 (7d977b12-14ee-479c-b091-9753a273c6c6): created successfully Feb 27 12:33:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc26ebc-d189-41aa-9fcd-820b42b510b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:32 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Flow 'volume_create_manager' (928b1725-6fc2-47aa-a2bd-6b1d7aa73e98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:32 devstack cinder-volume[83077]: INFO cinder.volume.manager [req-2289d385-baf2-467b-8415-751f3c7179d0 req-b17c9f46-e2b3-47cb-ad14-bfd4992cb868 tempest-VolumesSnapshotsTestJSON-977151512 None] Created volume successfully. Feb 27 12:33:32 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_7s_d242f" returned: 1 in 0.514s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_7s_d242f' failed. Not Retrying. {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:33:32 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c242b7-2c94-4b1b-ad7f-01f57b69deba]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_r0edcuc4devstack@QuobyteHD {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:32 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-136584f2-b004-4fcb-bf2c-ed81152ec586 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.444s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:32 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-136584f2-b004-4fcb-bf2c-ed81152ec586 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:32 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-136584f2-b004-4fcb-bf2c-ed81152ec586 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Deleted volume successfully. Feb 27 12:33:32 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-136584f2-b004-4fcb-bf2c-ed81152ec586 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "cinder-eea8e571-cb91-47ae-95c4-92bde234b2fe-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:32 devstack sudo[88865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_r0edcuc4devstack@QuobyteHD Feb 27 12:33:32 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-3790749f-66cc-4863-90f1-971e7ffd3eb6 req-3a421a7b-b13d-4160-bad0-1e16abda97fc tempest-VolumesSnapshotsTestJSON-977151512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-3790749f-66cc-4863-90f1-971e7ffd3eb6 req-3a421a7b-b13d-4160-bad0-1e16abda97fc tempest-VolumesSnapshotsTestJSON-977151512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:33 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [req-3790749f-66cc-4863-90f1-971e7ffd3eb6 req-3a421a7b-b13d-4160-bad0-1e16abda97fc tempest-VolumesSnapshotsTestJSON-977151512 None] Creating offline snapshot 60968f6c-ad0d-4642-b9c6-53e30df117aa of volume 7d977b12-14ee-479c-b091-9753a273c6c6 {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:33:33 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3c04a8-27c1-449c-9b86-a870d1589b1a]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-3790749f-66cc-4863-90f1-971e7ffd3eb6 req-3a421a7b-b13d-4160-bad0-1e16abda97fc tempest-VolumesSnapshotsTestJSON-977151512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:33 devstack sudo[88871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6 Feb 27 12:33:33 devstack sudo[88871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:33 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_r0edcuc4devstack@QuobyteHD" returned: 0 in 0.539s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:33 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] 9c0a1769-4e00-41fd-a047-783ef98efe34 was qcow2, converting to raw {{(pid=83077) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 12:33:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_r0edcuc4devstack@QuobyteHD /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:33 devstack sudo[88873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_r0edcuc4devstack@QuobyteHD /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313 Feb 27 12:33:33 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:33 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-e079bf93-b322-4125-8d62-bb311bcb8b40 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "cinder-f0f2b12c-f074-4e71-a355-5f07e4731332-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:33 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-e079bf93-b322-4125-8d62-bb311bcb8b40 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "cinder-f0f2b12c-f074-4e71-a355-5f07e4731332-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:33 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-e079bf93-b322-4125-8d62-bb311bcb8b40 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "cinder-quobyte-f0f2b12c-f074-4e71-a355-5f07e4731332" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:33 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-e079bf93-b322-4125-8d62-bb311bcb8b40 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "cinder-quobyte-f0f2b12c-f074-4e71-a355-5f07e4731332" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:33 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6710ef5-8b4c-4bb3-a3ca-87e6dd6c2816]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e079bf93-b322-4125-8d62-bb311bcb8b40 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f0f2b12c-f074-4e71-a355-5f07e4731332 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:33 devstack sudo[88875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f0f2b12c-f074-4e71-a355-5f07e4731332 Feb 27 12:33:33 devstack sudo[88875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:33 devstack sudo[88871]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-3790749f-66cc-4863-90f1-971e7ffd3eb6 req-3a421a7b-b13d-4160-bad0-1e16abda97fc tempest-VolumesSnapshotsTestJSON-977151512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6" returned: 0 in 0.575s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-3790749f-66cc-4863-90f1-971e7ffd3eb6 req-3a421a7b-b13d-4160-bad0-1e16abda97fc tempest-VolumesSnapshotsTestJSON-977151512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6.60968f6c-ad0d-4642-b9c6-53e30df117aa 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:33 devstack sudo[88895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6.60968f6c-ad0d-4642-b9c6-53e30df117aa 1G Feb 27 12:33:33 devstack sudo[88895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:34 devstack sudo[88875]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e079bf93-b322-4125-8d62-bb311bcb8b40 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f0f2b12c-f074-4e71-a355-5f07e4731332" returned: 0 in 0.564s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e079bf93-b322-4125-8d62-bb311bcb8b40 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f0f2b12c-f074-4e71-a355-5f07e4731332 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:34 devstack sudo[88900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f0f2b12c-f074-4e71-a355-5f07e4731332 Feb 27 12:33:34 devstack sudo[88900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:34 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_r0edcuc4devstack@QuobyteHD /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313" returned: 0 in 0.921s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:34 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_r0edcuc4devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313 {{(pid=83077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:33:34 devstack cinder-volume[83077]: INFO cinder.image.image_utils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Converted 112.00 MB image at 112.00 MB/s Feb 27 12:33:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:34 devstack sudo[88903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313 1G Feb 27 12:33:34 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:34 devstack sudo[88895]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-3790749f-66cc-4863-90f1-971e7ffd3eb6 req-3a421a7b-b13d-4160-bad0-1e16abda97fc tempest-VolumesSnapshotsTestJSON-977151512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6.60968f6c-ad0d-4642-b9c6-53e30df117aa 1G" returned: 0 in 0.630s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-3790749f-66cc-4863-90f1-971e7ffd3eb6 req-3a421a7b-b13d-4160-bad0-1e16abda97fc tempest-VolumesSnapshotsTestJSON-977151512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d977b12-14ee-479c-b091-9753a273c6c6 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6.60968f6c-ad0d-4642-b9c6-53e30df117aa {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:34 devstack sudo[88908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d977b12-14ee-479c-b091-9753a273c6c6 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6.60968f6c-ad0d-4642-b9c6-53e30df117aa Feb 27 12:33:34 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:34 devstack sudo[88900]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e079bf93-b322-4125-8d62-bb311bcb8b40 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f0f2b12c-f074-4e71-a355-5f07e4731332" returned: 0 in 0.498s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:34 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-e079bf93-b322-4125-8d62-bb311bcb8b40 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "cinder-quobyte-f0f2b12c-f074-4e71-a355-5f07e4731332" released by "delete_volume" :: held 1.095s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:34 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-e079bf93-b322-4125-8d62-bb311bcb8b40 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Created reservations ['50757829-3259-480a-a5a6-ce451c616ec6', '5ad51dc1-7f40-4d17-b3a2-7d0390787eae', '10ad46fd-9bc7-4aee-9ebf-c1369b2aaddf', '3353846d-72bf-4546-b3b4-13d25258eda4'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-e079bf93-b322-4125-8d62-bb311bcb8b40 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-e079bf93-b322-4125-8d62-bb311bcb8b40 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:34 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-e079bf93-b322-4125-8d62-bb311bcb8b40 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:34 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-e079bf93-b322-4125-8d62-bb311bcb8b40 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-e079bf93-b322-4125-8d62-bb311bcb8b40 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e079bf93-b322-4125-8d62-bb311bcb8b40 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:34 devstack sudo[88910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:33:34 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:34 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313 1G" returned: 0 in 0.463s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:34 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fa7073-4190-4505-acb1-9eda47138d7c]: (4, 'raw') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:34 devstack sudo[88915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313 Feb 27 12:33:34 devstack sudo[88915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:34 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-3790749f-66cc-4863-90f1-971e7ffd3eb6 req-3a421a7b-b13d-4160-bad0-1e16abda97fc tempest-VolumesSnapshotsTestJSON-977151512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d977b12-14ee-479c-b091-9753a273c6c6 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6.60968f6c-ad0d-4642-b9c6-53e30df117aa" returned: 0 in 0.445s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:34 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [req-3790749f-66cc-4863-90f1-971e7ffd3eb6 req-3a421a7b-b13d-4160-bad0-1e16abda97fc tempest-VolumesSnapshotsTestJSON-977151512 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6.60968f6c-ad0d-4642-b9c6-53e30df117aa is being set with open permissions: ugo+rw Feb 27 12:33:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-3790749f-66cc-4863-90f1-971e7ffd3eb6 req-3a421a7b-b13d-4160-bad0-1e16abda97fc tempest-VolumesSnapshotsTestJSON-977151512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6.60968f6c-ad0d-4642-b9c6-53e30df117aa {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:34 devstack sudo[88920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6.60968f6c-ad0d-4642-b9c6-53e30df117aa Feb 27 12:33:34 devstack sudo[88920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:35 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e079bf93-b322-4125-8d62-bb311bcb8b40 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.392s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:35 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-e079bf93-b322-4125-8d62-bb311bcb8b40 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:35 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-e079bf93-b322-4125-8d62-bb311bcb8b40 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Deleted volume successfully. Feb 27 12:33:35 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-e079bf93-b322-4125-8d62-bb311bcb8b40 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "cinder-f0f2b12c-f074-4e71-a355-5f07e4731332-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:35 devstack sudo[88915]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313" returned: 0 in 0.480s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:35 devstack sudo[88920]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-3790749f-66cc-4863-90f1-971e7ffd3eb6 req-3a421a7b-b13d-4160-bad0-1e16abda97fc tempest-VolumesSnapshotsTestJSON-977151512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6.60968f6c-ad0d-4642-b9c6-53e30df117aa" returned: 0 in 0.397s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:35 devstack sudo[88926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313 Feb 27 12:33:35 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-3790749f-66cc-4863-90f1-971e7ffd3eb6 req-3a421a7b-b13d-4160-bad0-1e16abda97fc tempest-VolumesSnapshotsTestJSON-977151512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:35 devstack sudo[88928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6.info Feb 27 12:33:35 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:35 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6ebd2c9e-18df-4700-b4f9-6df60b15cea6 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "cinder-0475ab16-a94e-4a64-90f2-379f01f66332-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:35 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6ebd2c9e-18df-4700-b4f9-6df60b15cea6 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "cinder-0475ab16-a94e-4a64-90f2-379f01f66332-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:35 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6ebd2c9e-18df-4700-b4f9-6df60b15cea6 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "cinder-quobyte-0475ab16-a94e-4a64-90f2-379f01f66332" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:35 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6ebd2c9e-18df-4700-b4f9-6df60b15cea6 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "cinder-quobyte-0475ab16-a94e-4a64-90f2-379f01f66332" acquired by "delete_volume" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:35 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd816dc-92c0-4781-809f-e18b1173e7d8]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6ebd2c9e-18df-4700-b4f9-6df60b15cea6 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-0475ab16-a94e-4a64-90f2-379f01f66332 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:35 devstack sudo[88930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-0475ab16-a94e-4a64-90f2-379f01f66332 Feb 27 12:33:35 devstack sudo[88930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:35 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313" returned: 1 in 0.497s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313' failed. Not Retrying. {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:33:35 devstack cinder-volume[83077]: DEBUG cinder.volume.volume_utils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Downloaded image 9c0a1769-4e00-41fd-a047-783ef98efe34 ((None, [{'url': 'file:///opt/stack/data/glance/images/9c0a1769-4e00-41fd-a047-783ef98efe34', 'metadata': {}}])) to volume e2e2cab5-6a95-4a7e-af74-c6d9d2395313 successfully. {{(pid=83077) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 12:33:35 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:35 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Temporary image 9c0a1769-4e00-41fd-a047-783ef98efe34 for user 11ce73168089450f82d1646adc780909 is deleted. {{(pid=83077) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 12:33:35 devstack cinder-volume[83077]: DEBUG cinder.volume.volume_utils [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Marking volume e2e2cab5-6a95-4a7e-af74-c6d9d2395313 as bootable. {{(pid=83077) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 12:33:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-3790749f-66cc-4863-90f1-971e7ffd3eb6 req-3a421a7b-b13d-4160-bad0-1e16abda97fc tempest-VolumesSnapshotsTestJSON-977151512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6.info" returned: 0 in 0.424s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:35 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [req-3790749f-66cc-4863-90f1-971e7ffd3eb6 req-3a421a7b-b13d-4160-bad0-1e16abda97fc tempest-VolumesSnapshotsTestJSON-977151512 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6.info is being set with open permissions: ugo+rw Feb 27 12:33:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-3790749f-66cc-4863-90f1-971e7ffd3eb6 req-3a421a7b-b13d-4160-bad0-1e16abda97fc tempest-VolumesSnapshotsTestJSON-977151512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:35 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Copying metadata from image 9c0a1769-4e00-41fd-a047-783ef98efe34 to e2e2cab5-6a95-4a7e-af74-c6d9d2395313. {{(pid=83077) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 12:33:35 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Creating volume glance metadata for volume e2e2cab5-6a95-4a7e-af74-c6d9d2395313 backed by image 9c0a1769-4e00-41fd-a047-783ef98efe34 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83077) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 12:33:35 devstack sudo[88936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6.info Feb 27 12:33:35 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34baf5f9-f89b-446e-a895-dbe17cb82afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313', 'volume_size': 1, 'image_id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c0a1769-4e00-41fd-a047-783ef98efe34', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa6a7971cf2a477f87f22a9fc435f45d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'created_at': datetime.datetime(2026, 2, 27, 11, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 11, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c0a1769-4e00-41fd-a047-783ef98efe34/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9707bddc-fb41-41f1-bf1d-93ce470e1883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:35 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Volume volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313 (e2e2cab5-6a95-4a7e-af74-c6d9d2395313): created successfully Feb 27 12:33:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9707bddc-fb41-41f1-bf1d-93ce470e1883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:35 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Flow 'volume_create_manager' (fcf2dd82-9684-4c3b-b7e8-ad25efd85be6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:35 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-a99fdbfc-5293-4e40-918e-3cf7255ba7e5 tempest-VolumesImageMetadata-80065200 None] Created volume successfully. Feb 27 12:33:36 devstack sudo[88930]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6ebd2c9e-18df-4700-b4f9-6df60b15cea6 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-0475ab16-a94e-4a64-90f2-379f01f66332" returned: 0 in 0.488s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6ebd2c9e-18df-4700-b4f9-6df60b15cea6 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-0475ab16-a94e-4a64-90f2-379f01f66332 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:36 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-3790749f-66cc-4863-90f1-971e7ffd3eb6 req-3a421a7b-b13d-4160-bad0-1e16abda97fc tempest-VolumesSnapshotsTestJSON-977151512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6.info" returned: 0 in 0.374s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-3790749f-66cc-4863-90f1-971e7ffd3eb6 req-3a421a7b-b13d-4160-bad0-1e16abda97fc tempest-VolumesSnapshotsTestJSON-977151512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.927s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:36 devstack sudo[88942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-0475ab16-a94e-4a64-90f2-379f01f66332 Feb 27 12:33:36 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:36 devstack cinder-volume[83077]: INFO cinder.volume.manager [req-3790749f-66cc-4863-90f1-971e7ffd3eb6 req-3a421a7b-b13d-4160-bad0-1e16abda97fc tempest-VolumesSnapshotsTestJSON-977151512 None] Create snapshot completed successfully Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-8fe5836f-53ea-4fb4-87bb-dfa4d30029e3 req-3062ee83-b401-4608-9546-54bcee7a77d0 tempest-VolumesSnapshotsTestJSON-977151512 None] Acquiring lock "cinder-60968f6c-ad0d-4642-b9c6-53e30df117aa-delete_snapshot" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-8fe5836f-53ea-4fb4-87bb-dfa4d30029e3 req-3062ee83-b401-4608-9546-54bcee7a77d0 tempest-VolumesSnapshotsTestJSON-977151512 None] Lock "cinder-60968f6c-ad0d-4642-b9c6-53e30df117aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-8fe5836f-53ea-4fb4-87bb-dfa4d30029e3 req-3062ee83-b401-4608-9546-54bcee7a77d0 tempest-VolumesSnapshotsTestJSON-977151512 None] Acquiring lock "cinder-quobyte-7d977b12-14ee-479c-b091-9753a273c6c6" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:36 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6ebd2c9e-18df-4700-b4f9-6df60b15cea6 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-0475ab16-a94e-4a64-90f2-379f01f66332" returned: 0 in 0.456s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6ebd2c9e-18df-4700-b4f9-6df60b15cea6 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "cinder-quobyte-0475ab16-a94e-4a64-90f2-379f01f66332" released by "delete_volume" :: held 0.967s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-8fe5836f-53ea-4fb4-87bb-dfa4d30029e3 req-3062ee83-b401-4608-9546-54bcee7a77d0 tempest-VolumesSnapshotsTestJSON-977151512 None] Lock "cinder-quobyte-7d977b12-14ee-479c-b091-9753a273c6c6" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-8fe5836f-53ea-4fb4-87bb-dfa4d30029e3 req-3062ee83-b401-4608-9546-54bcee7a77d0 tempest-VolumesSnapshotsTestJSON-977151512 None] Acquiring lock "cinder-quobyte-60968f6c-ad0d-4642-b9c6-53e30df117aa" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-8fe5836f-53ea-4fb4-87bb-dfa4d30029e3 req-3062ee83-b401-4608-9546-54bcee7a77d0 tempest-VolumesSnapshotsTestJSON-977151512 None] Lock "cinder-quobyte-60968f6c-ad0d-4642-b9c6-53e30df117aa" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [req-8fe5836f-53ea-4fb4-87bb-dfa4d30029e3 req-3062ee83-b401-4608-9546-54bcee7a77d0 tempest-VolumesSnapshotsTestJSON-977151512 None] Deleting offline snapshot 60968f6c-ad0d-4642-b9c6-53e30df117aa of volume 7d977b12-14ee-479c-b091-9753a273c6c6 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [req-8fe5836f-53ea-4fb4-87bb-dfa4d30029e3 req-3062ee83-b401-4608-9546-54bcee7a77d0 tempest-VolumesSnapshotsTestJSON-977151512 None] snapshot_file for this snap is: volume-7d977b12-14ee-479c-b091-9753a273c6c6.60968f6c-ad0d-4642-b9c6-53e30df117aa {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcae270-ba63-4a20-9a7b-d502d78d21d9]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-8fe5836f-53ea-4fb4-87bb-dfa4d30029e3 req-3062ee83-b401-4608-9546-54bcee7a77d0 tempest-VolumesSnapshotsTestJSON-977151512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6.60968f6c-ad0d-4642-b9c6-53e30df117aa {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-6ebd2c9e-18df-4700-b4f9-6df60b15cea6 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Created reservations ['385daaba-2364-4d6e-a36b-5b63bf65d35a', '7fb6da42-128f-42a4-a8fd-60af2e8bd6cb', 'b62e64de-32be-4f71-b402-3f2cc0c33b87', '1fa13d9a-01be-4378-b274-af7b9aa2fbe6'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-95337de0-76cb-4187-b3b4-3687491938b9 tempest-VolumesImageMetadata-80065200 None] Acquiring lock "cinder-e2e2cab5-6a95-4a7e-af74-c6d9d2395313-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-95337de0-76cb-4187-b3b4-3687491938b9 tempest-VolumesImageMetadata-80065200 None] Lock "cinder-e2e2cab5-6a95-4a7e-af74-c6d9d2395313-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-95337de0-76cb-4187-b3b4-3687491938b9 tempest-VolumesImageMetadata-80065200 None] Acquiring lock "cinder-quobyte-e2e2cab5-6a95-4a7e-af74-c6d9d2395313" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6ebd2c9e-18df-4700-b4f9-6df60b15cea6 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6ebd2c9e-18df-4700-b4f9-6df60b15cea6 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6ebd2c9e-18df-4700-b4f9-6df60b15cea6 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6ebd2c9e-18df-4700-b4f9-6df60b15cea6 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6ebd2c9e-18df-4700-b4f9-6df60b15cea6 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6ebd2c9e-18df-4700-b4f9-6df60b15cea6 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:36 devstack sudo[88945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6.60968f6c-ad0d-4642-b9c6-53e30df117aa Feb 27 12:33:36 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-95337de0-76cb-4187-b3b4-3687491938b9 tempest-VolumesImageMetadata-80065200 None] Lock "cinder-quobyte-e2e2cab5-6a95-4a7e-af74-c6d9d2395313" acquired by "delete_volume" :: waited 0.025s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:36 devstack sudo[88947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:33:36 devstack sudo[88947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e316a2-f341-41af-bc32-c2ce974d3b7b]: (4, 'raw') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-95337de0-76cb-4187-b3b4-3687491938b9 tempest-VolumesImageMetadata-80065200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:36 devstack sudo[88949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313 Feb 27 12:33:36 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:37 devstack sudo[88947]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6ebd2c9e-18df-4700-b4f9-6df60b15cea6 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.391s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:37 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-6ebd2c9e-18df-4700-b4f9-6df60b15cea6 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:37 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-6ebd2c9e-18df-4700-b4f9-6df60b15cea6 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Deleted volume successfully. Feb 27 12:33:37 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6ebd2c9e-18df-4700-b4f9-6df60b15cea6 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "cinder-0475ab16-a94e-4a64-90f2-379f01f66332-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:37 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-8fe5836f-53ea-4fb4-87bb-dfa4d30029e3 req-3062ee83-b401-4608-9546-54bcee7a77d0 tempest-VolumesSnapshotsTestJSON-977151512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6.60968f6c-ad0d-4642-b9c6-53e30df117aa" returned: 0 in 0.559s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:37 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [req-8fe5836f-53ea-4fb4-87bb-dfa4d30029e3 req-3062ee83-b401-4608-9546-54bcee7a77d0 tempest-VolumesSnapshotsTestJSON-977151512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d977b12-14ee-479c-b091-9753a273c6c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:33:37 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c52e3a-5509-4f8f-8135-b96fe998aeef]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-8fe5836f-53ea-4fb4-87bb-dfa4d30029e3 req-3062ee83-b401-4608-9546-54bcee7a77d0 tempest-VolumesSnapshotsTestJSON-977151512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:37 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-95337de0-76cb-4187-b3b4-3687491938b9 tempest-VolumesImageMetadata-80065200 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313" returned: 0 in 0.457s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-95337de0-76cb-4187-b3b4-3687491938b9 tempest-VolumesImageMetadata-80065200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:37 devstack sudo[88957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6 Feb 27 12:33:37 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:37 devstack sudo[88958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313 Feb 27 12:33:37 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:37 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-8fe5836f-53ea-4fb4-87bb-dfa4d30029e3 req-3062ee83-b401-4608-9546-54bcee7a77d0 tempest-VolumesSnapshotsTestJSON-977151512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6" returned: 0 in 0.461s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-8fe5836f-53ea-4fb4-87bb-dfa4d30029e3 req-3062ee83-b401-4608-9546-54bcee7a77d0 tempest-VolumesSnapshotsTestJSON-977151512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6.60968f6c-ad0d-4642-b9c6-53e30df117aa {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:37 devstack sudo[88967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6.60968f6c-ad0d-4642-b9c6-53e30df117aa Feb 27 12:33:37 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:37 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-95337de0-76cb-4187-b3b4-3687491938b9 tempest-VolumesImageMetadata-80065200 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313" returned: 1 in 0.476s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-95337de0-76cb-4187-b3b4-3687491938b9 tempest-VolumesImageMetadata-80065200 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313' failed. Not Retrying. {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:33:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-95337de0-76cb-4187-b3b4-3687491938b9 tempest-VolumesImageMetadata-80065200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:37 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8e93b6fc-b9c7-4523-afc1-66a7d61ebe41 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "cinder-66fb1f3e-ad5e-4edd-9c60-71625d87db7a-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:37 devstack sudo[88969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313 Feb 27 12:33:37 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:37 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8e93b6fc-b9c7-4523-afc1-66a7d61ebe41 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "cinder-66fb1f3e-ad5e-4edd-9c60-71625d87db7a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:37 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8e93b6fc-b9c7-4523-afc1-66a7d61ebe41 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "cinder-quobyte-66fb1f3e-ad5e-4edd-9c60-71625d87db7a" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:37 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8e93b6fc-b9c7-4523-afc1-66a7d61ebe41 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "cinder-quobyte-66fb1f3e-ad5e-4edd-9c60-71625d87db7a" acquired by "delete_volume" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:37 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6ad35e-3ee9-4012-bd34-7dc7fa2953c9]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8e93b6fc-b9c7-4523-afc1-66a7d61ebe41 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-66fb1f3e-ad5e-4edd-9c60-71625d87db7a {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:37 devstack sudo[88971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-66fb1f3e-ad5e-4edd-9c60-71625d87db7a Feb 27 12:33:37 devstack sudo[88971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:38 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:38 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-95337de0-76cb-4187-b3b4-3687491938b9 tempest-VolumesImageMetadata-80065200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e2e2cab5-6a95-4a7e-af74-c6d9d2395313" returned: 0 in 0.442s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-8fe5836f-53ea-4fb4-87bb-dfa4d30029e3 req-3062ee83-b401-4608-9546-54bcee7a77d0 tempest-VolumesSnapshotsTestJSON-977151512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6.60968f6c-ad0d-4642-b9c6-53e30df117aa" returned: 0 in 0.509s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-8fe5836f-53ea-4fb4-87bb-dfa4d30029e3 req-3062ee83-b401-4608-9546-54bcee7a77d0 tempest-VolumesSnapshotsTestJSON-977151512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6.60968f6c-ad0d-4642-b9c6-53e30df117aa {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-95337de0-76cb-4187-b3b4-3687491938b9 tempest-VolumesImageMetadata-80065200 None] Lock "cinder-quobyte-e2e2cab5-6a95-4a7e-af74-c6d9d2395313" released by "delete_volume" :: held 1.424s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:38 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6.60968f6c-ad0d-4642-b9c6-53e30df117aa Feb 27 12:33:38 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-95337de0-76cb-4187-b3b4-3687491938b9 tempest-VolumesImageMetadata-80065200 None] Created reservations ['1571c6d9-8963-4228-a334-248ae6a9c9e7', '1a0d3107-009d-429d-858d-b6c7661a0b08', 'b54cc8f6-eaa9-4fc3-8cfa-bc690254c6f4', '9c8bbbf8-f755-4756-9f8b-8777ff32dd5d'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-95337de0-76cb-4187-b3b4-3687491938b9 tempest-VolumesImageMetadata-80065200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-95337de0-76cb-4187-b3b4-3687491938b9 tempest-VolumesImageMetadata-80065200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-95337de0-76cb-4187-b3b4-3687491938b9 tempest-VolumesImageMetadata-80065200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-95337de0-76cb-4187-b3b4-3687491938b9 tempest-VolumesImageMetadata-80065200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-95337de0-76cb-4187-b3b4-3687491938b9 tempest-VolumesImageMetadata-80065200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-95337de0-76cb-4187-b3b4-3687491938b9 tempest-VolumesImageMetadata-80065200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:38 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:33:38 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:38 devstack sudo[88971]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8e93b6fc-b9c7-4523-afc1-66a7d61ebe41 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-66fb1f3e-ad5e-4edd-9c60-71625d87db7a" returned: 0 in 0.507s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8e93b6fc-b9c7-4523-afc1-66a7d61ebe41 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-66fb1f3e-ad5e-4edd-9c60-71625d87db7a {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:38 devstack sudo[88984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-66fb1f3e-ad5e-4edd-9c60-71625d87db7a Feb 27 12:33:38 devstack sudo[88984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:38 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-8fe5836f-53ea-4fb4-87bb-dfa4d30029e3 req-3062ee83-b401-4608-9546-54bcee7a77d0 tempest-VolumesSnapshotsTestJSON-977151512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6.60968f6c-ad0d-4642-b9c6-53e30df117aa" returned: 0 in 0.416s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-8fe5836f-53ea-4fb4-87bb-dfa4d30029e3 req-3062ee83-b401-4608-9546-54bcee7a77d0 tempest-VolumesSnapshotsTestJSON-977151512 None] Lock "cinder-quobyte-60968f6c-ad0d-4642-b9c6-53e30df117aa" released by "_delete_snapshot" :: held 2.016s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-8fe5836f-53ea-4fb4-87bb-dfa4d30029e3 req-3062ee83-b401-4608-9546-54bcee7a77d0 tempest-VolumesSnapshotsTestJSON-977151512 None] Lock "cinder-quobyte-7d977b12-14ee-479c-b091-9753a273c6c6" released by "delete_snapshot" :: held 2.040s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG cinder.quota [req-8fe5836f-53ea-4fb4-87bb-dfa4d30029e3 req-3062ee83-b401-4608-9546-54bcee7a77d0 tempest-VolumesSnapshotsTestJSON-977151512 None] Created reservations ['f74269bf-f213-4561-abde-8ff9e0471467', '6c7c2836-ba57-40fa-b89d-2f24a59af94a', '7dd55231-432d-4a2f-abff-67cce8b0776a', '84f024f8-1c22-4bdb-989d-58197c44f660'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:38 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-95337de0-76cb-4187-b3b4-3687491938b9 tempest-VolumesImageMetadata-80065200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.418s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-95337de0-76cb-4187-b3b4-3687491938b9 tempest-VolumesImageMetadata-80065200 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:38 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-95337de0-76cb-4187-b3b4-3687491938b9 tempest-VolumesImageMetadata-80065200 None] Deleted volume successfully. Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-95337de0-76cb-4187-b3b4-3687491938b9 tempest-VolumesImageMetadata-80065200 None] Lock "cinder-e2e2cab5-6a95-4a7e-af74-c6d9d2395313-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:38 devstack cinder-volume[83077]: INFO cinder.volume.manager [req-8fe5836f-53ea-4fb4-87bb-dfa4d30029e3 req-3062ee83-b401-4608-9546-54bcee7a77d0 tempest-VolumesSnapshotsTestJSON-977151512 None] Delete snapshot completed successfully. Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-8fe5836f-53ea-4fb4-87bb-dfa4d30029e3 req-3062ee83-b401-4608-9546-54bcee7a77d0 tempest-VolumesSnapshotsTestJSON-977151512 None] Lock "cinder-60968f6c-ad0d-4642-b9c6-53e30df117aa-delete_snapshot" released by "delete_snapshot" :: held 2.168s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:38 devstack sudo[88984]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8e93b6fc-b9c7-4523-afc1-66a7d61ebe41 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-66fb1f3e-ad5e-4edd-9c60-71625d87db7a" returned: 0 in 0.433s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8e93b6fc-b9c7-4523-afc1-66a7d61ebe41 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "cinder-quobyte-66fb1f3e-ad5e-4edd-9c60-71625d87db7a" released by "delete_volume" :: held 0.958s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-8e93b6fc-b9c7-4523-afc1-66a7d61ebe41 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Created reservations ['ad3ca203-8495-4e24-a9fa-d0e37814793f', '145df2d4-e3ad-4e95-9c41-a948e3c5dc84', 'c99a1dae-6269-4e77-a8c7-d46709b0d6b0', '1ecee38a-ed14-43e9-bba9-a2b74c81c6a3'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8e93b6fc-b9c7-4523-afc1-66a7d61ebe41 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8e93b6fc-b9c7-4523-afc1-66a7d61ebe41 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8e93b6fc-b9c7-4523-afc1-66a7d61ebe41 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8e93b6fc-b9c7-4523-afc1-66a7d61ebe41 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8e93b6fc-b9c7-4523-afc1-66a7d61ebe41 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8e93b6fc-b9c7-4523-afc1-66a7d61ebe41 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:38 devstack sudo[88989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:33:38 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-478852fb-fa75-48bd-a5bb-5e1a3ded4169 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "cinder-b4e86d49-7d3b-4b31-a692-daef01cb1f05-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:38 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-478852fb-fa75-48bd-a5bb-5e1a3ded4169 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "cinder-b4e86d49-7d3b-4b31-a692-daef01cb1f05-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:39 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-478852fb-fa75-48bd-a5bb-5e1a3ded4169 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "cinder-quobyte-b4e86d49-7d3b-4b31-a692-daef01cb1f05" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:39 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-478852fb-fa75-48bd-a5bb-5e1a3ded4169 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "cinder-quobyte-b4e86d49-7d3b-4b31-a692-daef01cb1f05" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:39 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da8759b-5d74-43a3-9298-b5abb47bdc08]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-478852fb-fa75-48bd-a5bb-5e1a3ded4169 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b4e86d49-7d3b-4b31-a692-daef01cb1f05 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:39 devstack sudo[88991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b4e86d49-7d3b-4b31-a692-daef01cb1f05 Feb 27 12:33:39 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:39 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8e93b6fc-b9c7-4523-afc1-66a7d61ebe41 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.474s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:39 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-8e93b6fc-b9c7-4523-afc1-66a7d61ebe41 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:39 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-8e93b6fc-b9c7-4523-afc1-66a7d61ebe41 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Deleted volume successfully. Feb 27 12:33:39 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8e93b6fc-b9c7-4523-afc1-66a7d61ebe41 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "cinder-66fb1f3e-ad5e-4edd-9c60-71625d87db7a-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:39 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-478852fb-fa75-48bd-a5bb-5e1a3ded4169 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b4e86d49-7d3b-4b31-a692-daef01cb1f05" returned: 0 in 0.507s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-478852fb-fa75-48bd-a5bb-5e1a3ded4169 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b4e86d49-7d3b-4b31-a692-daef01cb1f05 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:39 devstack sudo[88997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b4e86d49-7d3b-4b31-a692-daef01cb1f05 Feb 27 12:33:39 devstack sudo[88997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:39 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-18774502-08e0-419f-8e75-e5a764d779d9 req-912977e4-f51c-4302-b5a2-d9e790e06355 tempest-VolumesSnapshotsTestJSON-977151512 None] Acquiring lock "cinder-7d977b12-14ee-479c-b091-9753a273c6c6-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:39 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-18774502-08e0-419f-8e75-e5a764d779d9 req-912977e4-f51c-4302-b5a2-d9e790e06355 tempest-VolumesSnapshotsTestJSON-977151512 None] Lock "cinder-7d977b12-14ee-479c-b091-9753a273c6c6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:39 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-18774502-08e0-419f-8e75-e5a764d779d9 req-912977e4-f51c-4302-b5a2-d9e790e06355 tempest-VolumesSnapshotsTestJSON-977151512 None] Acquiring lock "cinder-quobyte-7d977b12-14ee-479c-b091-9753a273c6c6" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:39 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-18774502-08e0-419f-8e75-e5a764d779d9 req-912977e4-f51c-4302-b5a2-d9e790e06355 tempest-VolumesSnapshotsTestJSON-977151512 None] Lock "cinder-quobyte-7d977b12-14ee-479c-b091-9753a273c6c6" acquired by "delete_volume" :: waited 0.007s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:39 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e523021c-f25c-4292-bf8f-9e30e7878b69]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-18774502-08e0-419f-8e75-e5a764d779d9 req-912977e4-f51c-4302-b5a2-d9e790e06355 tempest-VolumesSnapshotsTestJSON-977151512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:40 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6 Feb 27 12:33:40 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:40 devstack sudo[88997]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-478852fb-fa75-48bd-a5bb-5e1a3ded4169 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-b4e86d49-7d3b-4b31-a692-daef01cb1f05" returned: 0 in 0.558s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:40 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-478852fb-fa75-48bd-a5bb-5e1a3ded4169 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "cinder-quobyte-b4e86d49-7d3b-4b31-a692-daef01cb1f05" released by "delete_volume" :: held 1.100s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:40 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-478852fb-fa75-48bd-a5bb-5e1a3ded4169 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Created reservations ['29d6e0bb-bde3-4eef-a0b9-4f5f78e5b535', 'ca158462-c3d7-4c83-93de-6ed222be2027', 'a3169f44-457a-4d4b-b4c5-6976349639c6', 'abde65bc-17b3-43ac-940e-ac140d4d407e'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-478852fb-fa75-48bd-a5bb-5e1a3ded4169 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-478852fb-fa75-48bd-a5bb-5e1a3ded4169 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:40 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-478852fb-fa75-48bd-a5bb-5e1a3ded4169 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:40 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-478852fb-fa75-48bd-a5bb-5e1a3ded4169 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-478852fb-fa75-48bd-a5bb-5e1a3ded4169 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-478852fb-fa75-48bd-a5bb-5e1a3ded4169 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:40 devstack sudo[89003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:33:40 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:40 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-18774502-08e0-419f-8e75-e5a764d779d9 req-912977e4-f51c-4302-b5a2-d9e790e06355 tempest-VolumesSnapshotsTestJSON-977151512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6" returned: 0 in 0.539s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-18774502-08e0-419f-8e75-e5a764d779d9 req-912977e4-f51c-4302-b5a2-d9e790e06355 tempest-VolumesSnapshotsTestJSON-977151512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:40 devstack sudo[89008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6 Feb 27 12:33:40 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:40 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-478852fb-fa75-48bd-a5bb-5e1a3ded4169 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.524s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:40 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-478852fb-fa75-48bd-a5bb-5e1a3ded4169 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:40 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-478852fb-fa75-48bd-a5bb-5e1a3ded4169 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Deleted volume successfully. Feb 27 12:33:40 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-478852fb-fa75-48bd-a5bb-5e1a3ded4169 tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "cinder-b4e86d49-7d3b-4b31-a692-daef01cb1f05-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:40 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-18774502-08e0-419f-8e75-e5a764d779d9 req-912977e4-f51c-4302-b5a2-d9e790e06355 tempest-VolumesSnapshotsTestJSON-977151512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7d977b12-14ee-479c-b091-9753a273c6c6" returned: 0 in 0.449s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:40 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-18774502-08e0-419f-8e75-e5a764d779d9 req-912977e4-f51c-4302-b5a2-d9e790e06355 tempest-VolumesSnapshotsTestJSON-977151512 None] Lock "cinder-quobyte-7d977b12-14ee-479c-b091-9753a273c6c6" released by "delete_volume" :: held 1.022s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:41 devstack cinder-volume[83077]: DEBUG cinder.quota [req-18774502-08e0-419f-8e75-e5a764d779d9 req-912977e4-f51c-4302-b5a2-d9e790e06355 tempest-VolumesSnapshotsTestJSON-977151512 None] Created reservations ['088b08e9-4ab4-40cb-914c-8aea00ec2794', '999a6ffe-a663-4bf1-86dc-31bf9149f5ef', '13172810-fe73-4151-b028-a41155fb9fd2', '2dff2062-7f8c-4bac-91fe-7b7241324a20'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-18774502-08e0-419f-8e75-e5a764d779d9 req-912977e4-f51c-4302-b5a2-d9e790e06355 tempest-VolumesSnapshotsTestJSON-977151512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-18774502-08e0-419f-8e75-e5a764d779d9 req-912977e4-f51c-4302-b5a2-d9e790e06355 tempest-VolumesSnapshotsTestJSON-977151512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:41 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-18774502-08e0-419f-8e75-e5a764d779d9 req-912977e4-f51c-4302-b5a2-d9e790e06355 tempest-VolumesSnapshotsTestJSON-977151512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:41 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [req-18774502-08e0-419f-8e75-e5a764d779d9 req-912977e4-f51c-4302-b5a2-d9e790e06355 tempest-VolumesSnapshotsTestJSON-977151512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [req-18774502-08e0-419f-8e75-e5a764d779d9 req-912977e4-f51c-4302-b5a2-d9e790e06355 tempest-VolumesSnapshotsTestJSON-977151512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-18774502-08e0-419f-8e75-e5a764d779d9 req-912977e4-f51c-4302-b5a2-d9e790e06355 tempest-VolumesSnapshotsTestJSON-977151512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:41 devstack sudo[89015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:33:41 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:41 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-745fdf12-452b-4592-a0ef-7453424b8a3b tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "cinder-6fd7629b-8400-4fec-9abc-49c7e882c998-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:41 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-745fdf12-452b-4592-a0ef-7453424b8a3b tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "cinder-6fd7629b-8400-4fec-9abc-49c7e882c998-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:41 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-745fdf12-452b-4592-a0ef-7453424b8a3b tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "cinder-quobyte-6fd7629b-8400-4fec-9abc-49c7e882c998" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:41 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-745fdf12-452b-4592-a0ef-7453424b8a3b tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "cinder-quobyte-6fd7629b-8400-4fec-9abc-49c7e882c998" acquired by "delete_volume" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:41 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bd3df7-1ff3-490f-ba7b-db90b781eb34]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-745fdf12-452b-4592-a0ef-7453424b8a3b tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6fd7629b-8400-4fec-9abc-49c7e882c998 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:41 devstack sudo[89017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6fd7629b-8400-4fec-9abc-49c7e882c998 Feb 27 12:33:41 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:41 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [req-18774502-08e0-419f-8e75-e5a764d779d9 req-912977e4-f51c-4302-b5a2-d9e790e06355 tempest-VolumesSnapshotsTestJSON-977151512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.510s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:41 devstack cinder-volume[83077]: DEBUG cinder.manager [req-18774502-08e0-419f-8e75-e5a764d779d9 req-912977e4-f51c-4302-b5a2-d9e790e06355 tempest-VolumesSnapshotsTestJSON-977151512 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:41 devstack cinder-volume[83077]: INFO cinder.volume.manager [req-18774502-08e0-419f-8e75-e5a764d779d9 req-912977e4-f51c-4302-b5a2-d9e790e06355 tempest-VolumesSnapshotsTestJSON-977151512 None] Deleted volume successfully. Feb 27 12:33:41 devstack cinder-volume[83077]: DEBUG cinder.coordination [req-18774502-08e0-419f-8e75-e5a764d779d9 req-912977e4-f51c-4302-b5a2-d9e790e06355 tempest-VolumesSnapshotsTestJSON-977151512 None] Lock "cinder-7d977b12-14ee-479c-b091-9753a273c6c6-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:41 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-745fdf12-452b-4592-a0ef-7453424b8a3b tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6fd7629b-8400-4fec-9abc-49c7e882c998" returned: 0 in 0.564s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-745fdf12-452b-4592-a0ef-7453424b8a3b tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6fd7629b-8400-4fec-9abc-49c7e882c998 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:41 devstack sudo[89023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6fd7629b-8400-4fec-9abc-49c7e882c998 Feb 27 12:33:41 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:42 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-745fdf12-452b-4592-a0ef-7453424b8a3b tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6fd7629b-8400-4fec-9abc-49c7e882c998" returned: 0 in 0.431s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:42 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-745fdf12-452b-4592-a0ef-7453424b8a3b tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "cinder-quobyte-6fd7629b-8400-4fec-9abc-49c7e882c998" released by "delete_volume" :: held 1.018s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:42 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-745fdf12-452b-4592-a0ef-7453424b8a3b tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Created reservations ['5eb8d060-9260-433d-b7bf-c0cb11004de0', '37d19a60-043f-46fa-a3ca-ce4ea9ce0c6d', '01653ed1-c413-464e-8490-5d0c34db9985', '2de4fd2c-7935-40f8-b6da-bc922c99fa16'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-745fdf12-452b-4592-a0ef-7453424b8a3b tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-745fdf12-452b-4592-a0ef-7453424b8a3b tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:42 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-745fdf12-452b-4592-a0ef-7453424b8a3b tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:42 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-745fdf12-452b-4592-a0ef-7453424b8a3b tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-745fdf12-452b-4592-a0ef-7453424b8a3b tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-745fdf12-452b-4592-a0ef-7453424b8a3b tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:42 devstack sudo[89026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:33:42 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:42 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-745fdf12-452b-4592-a0ef-7453424b8a3b tempest-CreateVolumesFromSourceVolumeTest-42420843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.459s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:42 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-745fdf12-452b-4592-a0ef-7453424b8a3b tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:42 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-745fdf12-452b-4592-a0ef-7453424b8a3b tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Deleted volume successfully. Feb 27 12:33:42 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-745fdf12-452b-4592-a0ef-7453424b8a3b tempest-CreateVolumesFromSourceVolumeTest-42420843 None] Lock "cinder-6fd7629b-8400-4fec-9abc-49c7e882c998-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:43 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:33:43 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Flow 'volume_create_manager' (14f2fd7d-6c52-4bc9-a3c5-9d263fdb1e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:43 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59047648-8f82-4d96-b9a6-1007e54653fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:43 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59047648-8f82-4d96-b9a6-1007e54653fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1916220859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ea1776-92f6-4e0a-bdb4-b7609e11ba43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796de59fe5694391bdf3f56419c98a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:44Z,use_quota=True,user_id='39c0ad74de344d26846842a35b8c58a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:43 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd590f76-9b26-48c2-b32a-3fc5fd1abe0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:43 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd590f76-9b26-48c2-b32a-3fc5fd1abe0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:43 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45e69e4d-c513-41cb-aeb7-81b3c2f45d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:43 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45e69e4d-c513-41cb-aeb7-81b3c2f45d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8ea1776-92f6-4e0a-bdb4-b7609e11ba43', 'volume_name': 'volume-e8ea1776-92f6-4e0a-bdb4-b7609e11ba43', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:43 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f43192-19d2-44c8-943b-318f8e5e831c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:43 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f43192-19d2-44c8-943b-318f8e5e831c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:43 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1fdad34-70ec-4bb5-944c-ffb45675053d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:43 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Volume e8ea1776-92f6-4e0a-bdb4-b7609e11ba43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8ea1776-92f6-4e0a-bdb4-b7609e11ba43', 'volume_size': 1} Feb 27 12:33:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:43 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1916220859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ea1776-92f6-4e0a-bdb4-b7609e11ba43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796de59fe5694391bdf3f56419c98a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:44Z,use_quota=True,user_id='39c0ad74de344d26846842a35b8c58a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:43 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Creating volume e8ea1776-92f6-4e0a-bdb4-b7609e11ba43 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:43 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:43 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:43 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:43 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:33:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e8ea1776-92f6-4e0a-bdb4-b7609e11ba43 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:43 devstack sudo[89031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e8ea1776-92f6-4e0a-bdb4-b7609e11ba43 1073741824 Feb 27 12:33:43 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:44 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e8ea1776-92f6-4e0a-bdb4-b7609e11ba43 1073741824" returned: 0 in 0.604s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e8ea1776-92f6-4e0a-bdb4-b7609e11ba43 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:44 devstack sudo[89036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e8ea1776-92f6-4e0a-bdb4-b7609e11ba43 Feb 27 12:33:44 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:45 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e8ea1776-92f6-4e0a-bdb4-b7609e11ba43" returned: 0 in 0.490s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1fdad34-70ec-4bb5-944c-ffb45675053d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8ea1776-92f6-4e0a-bdb4-b7609e11ba43', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da24958d-ef94-43ca-b449-e1955ae576e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:45 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Volume volume-e8ea1776-92f6-4e0a-bdb4-b7609e11ba43 (e8ea1776-92f6-4e0a-bdb4-b7609e11ba43): created successfully Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da24958d-ef94-43ca-b449-e1955ae576e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Flow 'volume_create_manager' (14f2fd7d-6c52-4bc9-a3c5-9d263fdb1e61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:45 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-650b989f-94a0-4c5d-96a3-53b4aaa4913d tempest-VolumesTransfersTest-388879658 None] Created volume successfully. Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Flow 'volume_create_manager' (f69f3f73-84cd-42c2-beab-ac20a321fe9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f561c6dd-6689-4c1c-b4d2-8f8a069f57cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f561c6dd-6689-4c1c-b4d2-8f8a069f57cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-530379099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=034cac31-79ed-4000-9bf9-6e7fc6f3101d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b863a2fa783048bc939a7e0c4c6ddfbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:45Z,use_quota=True,user_id='d17e1bf5a2aa4e6abde46fbaab53abbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (782695ad-ea76-4612-aafb-725022ca7231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (782695ad-ea76-4612-aafb-725022ca7231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a70d9ae7-628d-4b88-b0b1-4510a14ac2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a70d9ae7-628d-4b88-b0b1-4510a14ac2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '034cac31-79ed-4000-9bf9-6e7fc6f3101d', 'volume_name': 'volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ae5006-540e-4903-bb17-a9b1ee7d4d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ae5006-540e-4903-bb17-a9b1ee7d4d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a3bf69-5c49-4a30-8afa-46c872876899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:45 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Volume 034cac31-79ed-4000-9bf9-6e7fc6f3101d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d', 'volume_size': 1} Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-530379099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=034cac31-79ed-4000-9bf9-6e7fc6f3101d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b863a2fa783048bc939a7e0c4c6ddfbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:45Z,use_quota=True,user_id='d17e1bf5a2aa4e6abde46fbaab53abbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Creating volume 034cac31-79ed-4000-9bf9-6e7fc6f3101d {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:45 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:45 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d 1073741824 Feb 27 12:33:45 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7fd896e5-476f-4985-a8fb-96ab83c32670 tempest-BackendsCapabilitiesAdminTestsJSON-1445089622 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580642700195, 'free_capacity_gb': 1775.7580642700195, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83077) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Feb 27 12:33:45 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d 1073741824" returned: 0 in 0.469s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:45 devstack sudo[89045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d Feb 27 12:33:45 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:46 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-14515adb-fa27-4cb0-a479-c1063f3f3023 tempest-VolumesTransfersTest-1877540492 None] Transfer volume completed successfully. Feb 27 12:33:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-c2e1114d-54af-4984-90cc-ca95da6876a7 tempest-BackendsCapabilitiesAdminTestsJSON-1445089622 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580642700195, 'free_capacity_gb': 1775.7580642700195, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83077) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Feb 27 12:33:46 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d" returned: 0 in 0.442s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:46 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a3bf69-5c49-4a30-8afa-46c872876899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe125d85-0a9c-48ec-b30b-d794021acdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:46 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Volume volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d (034cac31-79ed-4000-9bf9-6e7fc6f3101d): created successfully Feb 27 12:33:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe125d85-0a9c-48ec-b30b-d794021acdd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:46 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Flow 'volume_create_manager' (f69f3f73-84cd-42c2-beab-ac20a321fe9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:46 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-78b4090a-ca2e-4e73-8e6c-b617e159e88d tempest-VolumeDependencyTests-452734889 None] Created volume successfully. Feb 27 12:33:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-28619c44-5594-4529-9323-104c32bc2b57 tempest-VolumeDependencyTests-452734889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-28619c44-5594-4529-9323-104c32bc2b57 tempest-VolumeDependencyTests-452734889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:47 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-28619c44-5594-4529-9323-104c32bc2b57 tempest-VolumeDependencyTests-452734889 None] Creating offline snapshot 890da048-6c17-4dfe-8b92-4cfcde4f75f8 of volume 034cac31-79ed-4000-9bf9-6e7fc6f3101d {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:33:47 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[818c4897-78b6-4aac-b611-291aa63a9147]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-28619c44-5594-4529-9323-104c32bc2b57 tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:47 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a758f223-33e1-4a6f-8b23-b6a62a719db8 tempest-VolumesTransfersTest-1007041506 None] Acquiring lock "cinder-e8ea1776-92f6-4e0a-bdb4-b7609e11ba43-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:47 devstack sudo[89048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d Feb 27 12:33:47 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:47 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a758f223-33e1-4a6f-8b23-b6a62a719db8 tempest-VolumesTransfersTest-1007041506 None] Lock "cinder-e8ea1776-92f6-4e0a-bdb4-b7609e11ba43-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:47 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a758f223-33e1-4a6f-8b23-b6a62a719db8 tempest-VolumesTransfersTest-1007041506 None] Acquiring lock "cinder-quobyte-e8ea1776-92f6-4e0a-bdb4-b7609e11ba43" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:47 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a758f223-33e1-4a6f-8b23-b6a62a719db8 tempest-VolumesTransfersTest-1007041506 None] Lock "cinder-quobyte-e8ea1776-92f6-4e0a-bdb4-b7609e11ba43" acquired by "delete_volume" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:47 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56d8f49-d036-48e5-8f38-6d0eddccde23]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a758f223-33e1-4a6f-8b23-b6a62a719db8 tempest-VolumesTransfersTest-1007041506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e8ea1776-92f6-4e0a-bdb4-b7609e11ba43 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:47 devstack sudo[89050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e8ea1776-92f6-4e0a-bdb4-b7609e11ba43 Feb 27 12:33:47 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:47 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-28619c44-5594-4529-9323-104c32bc2b57 tempest-VolumeDependencyTests-452734889 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d" returned: 0 in 0.551s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-28619c44-5594-4529-9323-104c32bc2b57 tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.890da048-6c17-4dfe-8b92-4cfcde4f75f8 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:47 devstack sudo[89055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.890da048-6c17-4dfe-8b92-4cfcde4f75f8 1G Feb 27 12:33:47 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:47 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a758f223-33e1-4a6f-8b23-b6a62a719db8 tempest-VolumesTransfersTest-1007041506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e8ea1776-92f6-4e0a-bdb4-b7609e11ba43" returned: 0 in 0.521s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a758f223-33e1-4a6f-8b23-b6a62a719db8 tempest-VolumesTransfersTest-1007041506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e8ea1776-92f6-4e0a-bdb4-b7609e11ba43 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:47 devstack sudo[89060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e8ea1776-92f6-4e0a-bdb4-b7609e11ba43 Feb 27 12:33:47 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:48 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-28619c44-5594-4529-9323-104c32bc2b57 tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.890da048-6c17-4dfe-8b92-4cfcde4f75f8 1G" returned: 0 in 0.562s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-28619c44-5594-4529-9323-104c32bc2b57 tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.890da048-6c17-4dfe-8b92-4cfcde4f75f8 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:48 devstack sudo[89066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.890da048-6c17-4dfe-8b92-4cfcde4f75f8 Feb 27 12:33:48 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:48 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a758f223-33e1-4a6f-8b23-b6a62a719db8 tempest-VolumesTransfersTest-1007041506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e8ea1776-92f6-4e0a-bdb4-b7609e11ba43" returned: 0 in 0.499s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:48 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a758f223-33e1-4a6f-8b23-b6a62a719db8 tempest-VolumesTransfersTest-1007041506 None] Lock "cinder-quobyte-e8ea1776-92f6-4e0a-bdb4-b7609e11ba43" released by "delete_volume" :: held 1.052s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:48 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-a758f223-33e1-4a6f-8b23-b6a62a719db8 tempest-VolumesTransfersTest-1007041506 None] Created reservations ['db0af7e2-b8ea-4f4f-94fe-b3d0fc9badd3', '73269255-5b1a-4f39-ba74-aaadc86a9a47', 'de5937e8-16d8-42bf-950e-4350806ea471', '9fd8a2b4-20ee-4745-8855-a8518c6e1609'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a758f223-33e1-4a6f-8b23-b6a62a719db8 tempest-VolumesTransfersTest-1007041506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a758f223-33e1-4a6f-8b23-b6a62a719db8 tempest-VolumesTransfersTest-1007041506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:48 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a758f223-33e1-4a6f-8b23-b6a62a719db8 tempest-VolumesTransfersTest-1007041506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:48 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a758f223-33e1-4a6f-8b23-b6a62a719db8 tempest-VolumesTransfersTest-1007041506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a758f223-33e1-4a6f-8b23-b6a62a719db8 tempest-VolumesTransfersTest-1007041506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a758f223-33e1-4a6f-8b23-b6a62a719db8 tempest-VolumesTransfersTest-1007041506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:48 devstack sudo[89068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:33:48 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:48 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-28619c44-5594-4529-9323-104c32bc2b57 tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.890da048-6c17-4dfe-8b92-4cfcde4f75f8" returned: 0 in 0.505s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:48 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-28619c44-5594-4529-9323-104c32bc2b57 tempest-VolumeDependencyTests-452734889 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.890da048-6c17-4dfe-8b92-4cfcde4f75f8 is being set with open permissions: ugo+rw Feb 27 12:33:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-28619c44-5594-4529-9323-104c32bc2b57 tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.890da048-6c17-4dfe-8b92-4cfcde4f75f8 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:48 devstack sudo[89073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.890da048-6c17-4dfe-8b92-4cfcde4f75f8 Feb 27 12:33:48 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:48 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a758f223-33e1-4a6f-8b23-b6a62a719db8 tempest-VolumesTransfersTest-1007041506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.471s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:48 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-a758f223-33e1-4a6f-8b23-b6a62a719db8 tempest-VolumesTransfersTest-1007041506 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:48 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-a758f223-33e1-4a6f-8b23-b6a62a719db8 tempest-VolumesTransfersTest-1007041506 None] Deleted volume successfully. Feb 27 12:33:48 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a758f223-33e1-4a6f-8b23-b6a62a719db8 tempest-VolumesTransfersTest-1007041506 None] Lock "cinder-e8ea1776-92f6-4e0a-bdb4-b7609e11ba43-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:49 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-28619c44-5594-4529-9323-104c32bc2b57 tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.890da048-6c17-4dfe-8b92-4cfcde4f75f8" returned: 0 in 0.437s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-28619c44-5594-4529-9323-104c32bc2b57 tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:49 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.info Feb 27 12:33:49 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:49 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-28619c44-5594-4529-9323-104c32bc2b57 tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.info" returned: 0 in 0.484s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:49 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-28619c44-5594-4529-9323-104c32bc2b57 tempest-VolumeDependencyTests-452734889 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.info is being set with open permissions: ugo+rw Feb 27 12:33:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-28619c44-5594-4529-9323-104c32bc2b57 tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:49 devstack sudo[89080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.info Feb 27 12:33:49 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:49 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:33:49 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Flow 'volume_create_manager' (aaabe0d4-e3a7-4934-a6f7-ec005ee4e6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:49 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc86bcf5-f1c1-4812-a583-fc8c8b0ffe4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:49 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc86bcf5-f1c1-4812-a583-fc8c8b0ffe4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1993754162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab732bb-d311-4ad9-b49e-fe5abedfaf05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796de59fe5694391bdf3f56419c98a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:50Z,use_quota=True,user_id='39c0ad74de344d26846842a35b8c58a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:49 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2c9082-1ec2-4c26-9445-653e2351ff1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:49 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2c9082-1ec2-4c26-9445-653e2351ff1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:49 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6aed1d5-b2cd-4858-8646-6ece13114e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:49 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6aed1d5-b2cd-4858-8646-6ece13114e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eab732bb-d311-4ad9-b49e-fe5abedfaf05', 'volume_name': 'volume-eab732bb-d311-4ad9-b49e-fe5abedfaf05', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:49 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b628da0-44af-44f8-9dec-f88001ba4a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:49 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b628da0-44af-44f8-9dec-f88001ba4a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:49 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb0bdf1-66c4-4c3c-bd10-465e06991a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:49 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Volume eab732bb-d311-4ad9-b49e-fe5abedfaf05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eab732bb-d311-4ad9-b49e-fe5abedfaf05', 'volume_size': 1} Feb 27 12:33:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:50 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-28619c44-5594-4529-9323-104c32bc2b57 tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.info" returned: 0 in 0.454s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-28619c44-5594-4529-9323-104c32bc2b57 tempest-VolumeDependencyTests-452734889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.045s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.365s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:50 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1993754162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab732bb-d311-4ad9-b49e-fe5abedfaf05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796de59fe5694391bdf3f56419c98a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:50Z,use_quota=True,user_id='39c0ad74de344d26846842a35b8c58a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:50 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Creating volume eab732bb-d311-4ad9-b49e-fe5abedfaf05 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:50 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:50 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:50 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:50 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:33:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eab732bb-d311-4ad9-b49e-fe5abedfaf05 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:50 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-28619c44-5594-4529-9323-104c32bc2b57 tempest-VolumeDependencyTests-452734889 None] Create snapshot completed successfully Feb 27 12:33:50 devstack sudo[89083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eab732bb-d311-4ad9-b49e-fe5abedfaf05 1073741824 Feb 27 12:33:50 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:50 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eab732bb-d311-4ad9-b49e-fe5abedfaf05 1073741824" returned: 0 in 0.506s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eab732bb-d311-4ad9-b49e-fe5abedfaf05 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:50 devstack sudo[89088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eab732bb-d311-4ad9-b49e-fe5abedfaf05 Feb 27 12:33:50 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:51 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eab732bb-d311-4ad9-b49e-fe5abedfaf05" returned: 0 in 0.437s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb0bdf1-66c4-4c3c-bd10-465e06991a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eab732bb-d311-4ad9-b49e-fe5abedfaf05', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (502f4381-0e88-456d-b1f7-bd45b59a1b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:51 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Volume volume-eab732bb-d311-4ad9-b49e-fe5abedfaf05 (eab732bb-d311-4ad9-b49e-fe5abedfaf05): created successfully Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (502f4381-0e88-456d-b1f7-bd45b59a1b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Flow 'volume_create_manager' (aaabe0d4-e3a7-4934-a6f7-ec005ee4e6ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:51 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-cbf06e17-8482-42d5-8f81-303e7be1e759 tempest-VolumesTransfersTest-388879658 None] Created volume successfully. Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Flow 'volume_create_manager' (9742f330-7dcc-42bb-aed2-9149d2cea462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce92961-461b-4faf-98eb-c1aa1bdb19a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce92961-461b-4faf-98eb-c1aa1bdb19a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1643923277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d0add9e-04c7-4c99-a53f-a3c2a7c999e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b863a2fa783048bc939a7e0c4c6ddfbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=890da048-6c17-4dfe-8b92-4cfcde4f75f8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:52Z,use_quota=True,user_id='d17e1bf5a2aa4e6abde46fbaab53abbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3487e6f-d15d-42bf-abe3-810461777536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3487e6f-d15d-42bf-abe3-810461777536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a76754b-fc7f-415c-bb00-c8890ac664bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a76754b-fc7f-415c-bb00-c8890ac664bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0d0add9e-04c7-4c99-a53f-a3c2a7c999e5', 'volume_name': 'volume-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5', 'volume_size': 1, 'snapshot_id': '890da048-6c17-4dfe-8b92-4cfcde4f75f8'}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d95804-124f-43cc-8ae5-181da3f4826b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d95804-124f-43cc-8ae5-181da3f4826b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcaacac7-f892-428a-9142-c89927d7136a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:51 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Volume 0d0add9e-04c7-4c99-a53f-a3c2a7c999e5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5', 'volume_size': 1, 'snapshot_id': '890da048-6c17-4dfe-8b92-4cfcde4f75f8'} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Acquiring lock "cinder-quobyte-890da048-6c17-4dfe-8b92-4cfcde4f75f8-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5" by "_create_volume_from_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Lock "cinder-quobyte-890da048-6c17-4dfe-8b92-4cfcde4f75f8-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Creating volume 0d0add9e-04c7-4c99-a53f-a3c2a7c999e5 from snapshot 890da048-6c17-4dfe-8b92-4cfcde4f75f8 {{(pid=83077) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Acquiring lock "cinder-quobyte-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5" by "_copy_volume_from_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Lock "cinder-quobyte-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] snapshot: 890da048-6c17-4dfe-8b92-4cfcde4f75f8, volume: 0d0add9e-04c7-4c99-a53f-a3c2a7c999e5, {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2585eb-f790-410b-b446-f696d90569c3]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.890da048-6c17-4dfe-8b92-4cfcde4f75f8 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:51 devstack sudo[89092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.890da048-6c17-4dfe-8b92-4cfcde4f75f8 Feb 27 12:33:51 devstack sudo[89092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:52 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d33d6590-660c-49ff-95bc-58aadf24e4b3 tempest-VolumesTransfersTest-1007041506 None] Acquiring lock "cinder-eab732bb-d311-4ad9-b49e-fe5abedfaf05-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:52 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d33d6590-660c-49ff-95bc-58aadf24e4b3 tempest-VolumesTransfersTest-1007041506 None] Lock "cinder-eab732bb-d311-4ad9-b49e-fe5abedfaf05-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:52 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d33d6590-660c-49ff-95bc-58aadf24e4b3 tempest-VolumesTransfersTest-1007041506 None] Acquiring lock "cinder-quobyte-eab732bb-d311-4ad9-b49e-fe5abedfaf05" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:52 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d33d6590-660c-49ff-95bc-58aadf24e4b3 tempest-VolumesTransfersTest-1007041506 None] Lock "cinder-quobyte-eab732bb-d311-4ad9-b49e-fe5abedfaf05" acquired by "delete_volume" :: waited 0.014s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:52 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[67594981-78c0-4c8b-8008-8816a919185e]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d33d6590-660c-49ff-95bc-58aadf24e4b3 tempest-VolumesTransfersTest-1007041506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eab732bb-d311-4ad9-b49e-fe5abedfaf05 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:52 devstack sudo[89094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eab732bb-d311-4ad9-b49e-fe5abedfaf05 Feb 27 12:33:52 devstack sudo[89094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:52 devstack sudo[89092]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.890da048-6c17-4dfe-8b92-4cfcde4f75f8" returned: 0 in 0.640s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:52 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:33:52 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 12:33:52 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Creating direct copy from snapshot {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 12:33:52 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab94eb6b-b9c8-4ad1-85c6-38aa44af9f27]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:52 devstack sudo[89099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d Feb 27 12:33:52 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:52 devstack sudo[89094]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d33d6590-660c-49ff-95bc-58aadf24e4b3 tempest-VolumesTransfersTest-1007041506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eab732bb-d311-4ad9-b49e-fe5abedfaf05" returned: 0 in 0.598s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d33d6590-660c-49ff-95bc-58aadf24e4b3 tempest-VolumesTransfersTest-1007041506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eab732bb-d311-4ad9-b49e-fe5abedfaf05 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:52 devstack sudo[89104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eab732bb-d311-4ad9-b49e-fe5abedfaf05 Feb 27 12:33:52 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:52 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d" returned: 0 in 0.517s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:52 devstack cinder-volume[83077]: DEBUG cinder.utils [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Path /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5 not found in is_blk_device check {{(pid=83077) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 12:33:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:53 devstack sudo[89109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5 Feb 27 12:33:53 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:53 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d33d6590-660c-49ff-95bc-58aadf24e4b3 tempest-VolumesTransfersTest-1007041506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eab732bb-d311-4ad9-b49e-fe5abedfaf05" returned: 0 in 0.491s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:53 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d33d6590-660c-49ff-95bc-58aadf24e4b3 tempest-VolumesTransfersTest-1007041506 None] Lock "cinder-quobyte-eab732bb-d311-4ad9-b49e-fe5abedfaf05" released by "delete_volume" :: held 1.149s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:53 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-d33d6590-660c-49ff-95bc-58aadf24e4b3 tempest-VolumesTransfersTest-1007041506 None] Created reservations ['f4e638cd-b025-4dbe-89e6-99880793ed58', '074c0bb2-6e6e-4b36-908e-e4e32027cbdb', '3b1b4b33-ed30-40af-8753-2d846ac9df83', 'bfbdbcb8-959a-4006-be08-a09611bb9483'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d33d6590-660c-49ff-95bc-58aadf24e4b3 tempest-VolumesTransfersTest-1007041506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d33d6590-660c-49ff-95bc-58aadf24e4b3 tempest-VolumesTransfersTest-1007041506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:53 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d33d6590-660c-49ff-95bc-58aadf24e4b3 tempest-VolumesTransfersTest-1007041506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:53 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d33d6590-660c-49ff-95bc-58aadf24e4b3 tempest-VolumesTransfersTest-1007041506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d33d6590-660c-49ff-95bc-58aadf24e4b3 tempest-VolumesTransfersTest-1007041506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d33d6590-660c-49ff-95bc-58aadf24e4b3 tempest-VolumesTransfersTest-1007041506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:53 devstack sudo[89115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:33:53 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:54 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d33d6590-660c-49ff-95bc-58aadf24e4b3 tempest-VolumesTransfersTest-1007041506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 1.186s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:54 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-d33d6590-660c-49ff-95bc-58aadf24e4b3 tempest-VolumesTransfersTest-1007041506 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:54 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-d33d6590-660c-49ff-95bc-58aadf24e4b3 tempest-VolumesTransfersTest-1007041506 None] Deleted volume successfully. Feb 27 12:33:54 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d33d6590-660c-49ff-95bc-58aadf24e4b3 tempest-VolumesTransfersTest-1007041506 None] Lock "cinder-eab732bb-d311-4ad9-b49e-fe5abedfaf05-delete_volume" released by "delete_volume" :: held 2.518s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:55 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-292721a9-10f9-42a0-af4a-92443377a696 tempest-GroupsV320Test-1092695017 None] Group tempest-GroupsV320Test-Group-1786717322: creating Feb 27 12:33:55 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-292721a9-10f9-42a0-af4a-92443377a696 tempest-GroupsV320Test-1092695017 None] Group tempest-GroupsV320Test-Group-1786717322: created successfully Feb 27 12:33:55 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-292721a9-10f9-42a0-af4a-92443377a696 tempest-GroupsV320Test-1092695017 None] Create group completed successfully. Feb 27 12:33:55 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5" returned: 0 in 2.367s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:55 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f17269f-63b4-4ef9-9569-4a9820e7a5f4]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:55 devstack sudo[89125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d Feb 27 12:33:55 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:55 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d" returned: 0 in 0.602s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:55 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Image conversion details: src /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d, size 1024.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5 {{(pid=83077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:33:55 devstack cinder-volume[83077]: INFO cinder.image.image_utils [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Converted 1024.00 MB image at 432.45 MB/s Feb 27 12:33:55 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5 is being set with open permissions: ugo+rw Feb 27 12:33:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:55 devstack sudo[89130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5 Feb 27 12:33:55 devstack sudo[89130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:56 devstack sudo[89130]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5" returned: 0 in 0.473s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:56 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Lock "cinder-quobyte-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5" released by "_copy_volume_from_snapshot" :: held 4.689s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:56 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Lock "cinder-quobyte-890da048-6c17-4dfe-8b92-4cfcde4f75f8-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5" released by "_create_volume_from_snapshot" :: held 4.724s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.740s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:56 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcaacac7-f892-428a-9142-c89927d7136a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5', 'volume_size': 1, 'snapshot_id': '890da048-6c17-4dfe-8b92-4cfcde4f75f8'}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:56 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e12d5c9b-37ac-4ac8-906e-0d8442acd008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:56 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-ea00dc9a-47cf-46a7-be5e-c78e6e675b10 tempest-GroupsV320Test-1092695017 None] Created reservations ['9a6209c2-cc48-4e48-ad29-c8286ecc4045'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:56 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Volume volume-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5 (0d0add9e-04c7-4c99-a53f-a3c2a7c999e5): created successfully Feb 27 12:33:56 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e12d5c9b-37ac-4ac8-906e-0d8442acd008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:56 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Flow 'volume_create_manager' (9742f330-7dcc-42bb-aed2-9149d2cea462) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:56 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-858efcc3-cc29-4a20-b056-57288590c491 tempest-VolumeDependencyTests-452734889 None] Created volume successfully. Feb 27 12:33:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ea00dc9a-47cf-46a7-be5e-c78e6e675b10 tempest-GroupsV320Test-1092695017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ea00dc9a-47cf-46a7-be5e-c78e6e675b10 tempest-GroupsV320Test-1092695017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:56 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ea00dc9a-47cf-46a7-be5e-c78e6e675b10 tempest-GroupsV320Test-1092695017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:56 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ea00dc9a-47cf-46a7-be5e-c78e6e675b10 tempest-GroupsV320Test-1092695017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ea00dc9a-47cf-46a7-be5e-c78e6e675b10 tempest-GroupsV320Test-1092695017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ea00dc9a-47cf-46a7-be5e-c78e6e675b10 tempest-GroupsV320Test-1092695017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:56 devstack sudo[89133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:33:56 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:56 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ea00dc9a-47cf-46a7-be5e-c78e6e675b10 tempest-GroupsV320Test-1092695017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.436s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:56 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-ea00dc9a-47cf-46a7-be5e-c78e6e675b10 tempest-GroupsV320Test-1092695017 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:56 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-ea00dc9a-47cf-46a7-be5e-c78e6e675b10 tempest-GroupsV320Test-1092695017 None] Delete group completed successfully. Feb 27 12:33:57 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8649b03b-cf41-4cde-b43c-3b0100c807da tempest-VolumeDependencyTests-452734889 None] Acquiring lock "cinder-890da048-6c17-4dfe-8b92-4cfcde4f75f8-delete_snapshot" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:57 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8649b03b-cf41-4cde-b43c-3b0100c807da tempest-VolumeDependencyTests-452734889 None] Lock "cinder-890da048-6c17-4dfe-8b92-4cfcde4f75f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:57 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8649b03b-cf41-4cde-b43c-3b0100c807da tempest-VolumeDependencyTests-452734889 None] Acquiring lock "cinder-quobyte-034cac31-79ed-4000-9bf9-6e7fc6f3101d" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:57 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8649b03b-cf41-4cde-b43c-3b0100c807da tempest-VolumeDependencyTests-452734889 None] Lock "cinder-quobyte-034cac31-79ed-4000-9bf9-6e7fc6f3101d" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:57 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8649b03b-cf41-4cde-b43c-3b0100c807da tempest-VolumeDependencyTests-452734889 None] Acquiring lock "cinder-quobyte-890da048-6c17-4dfe-8b92-4cfcde4f75f8" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:57 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8649b03b-cf41-4cde-b43c-3b0100c807da tempest-VolumeDependencyTests-452734889 None] Lock "cinder-quobyte-890da048-6c17-4dfe-8b92-4cfcde4f75f8" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-8649b03b-cf41-4cde-b43c-3b0100c807da tempest-VolumeDependencyTests-452734889 None] Deleting offline snapshot 890da048-6c17-4dfe-8b92-4cfcde4f75f8 of volume 034cac31-79ed-4000-9bf9-6e7fc6f3101d {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:33:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-8649b03b-cf41-4cde-b43c-3b0100c807da tempest-VolumeDependencyTests-452734889 None] snapshot_file for this snap is: volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.890da048-6c17-4dfe-8b92-4cfcde4f75f8 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:33:57 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[8107da1e-4199-4936-8e53-f09a2f7fbb1d]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8649b03b-cf41-4cde-b43c-3b0100c807da tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.890da048-6c17-4dfe-8b92-4cfcde4f75f8 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:57 devstack sudo[89136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.890da048-6c17-4dfe-8b92-4cfcde4f75f8 Feb 27 12:33:57 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:57 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8649b03b-cf41-4cde-b43c-3b0100c807da tempest-VolumeDependencyTests-452734889 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.890da048-6c17-4dfe-8b92-4cfcde4f75f8" returned: 0 in 0.564s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-8649b03b-cf41-4cde-b43c-3b0100c807da tempest-VolumeDependencyTests-452734889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:33:57 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[89399e85-2e42-447a-be62-50296cc5ff16]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8649b03b-cf41-4cde-b43c-3b0100c807da tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:57 devstack sudo[89141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d Feb 27 12:33:57 devstack sudo[89141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:58 devstack sudo[89141]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8649b03b-cf41-4cde-b43c-3b0100c807da tempest-VolumeDependencyTests-452734889 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d" returned: 0 in 0.556s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8649b03b-cf41-4cde-b43c-3b0100c807da tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.890da048-6c17-4dfe-8b92-4cfcde4f75f8 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:58 devstack sudo[89146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.890da048-6c17-4dfe-8b92-4cfcde4f75f8 Feb 27 12:33:58 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:58 devstack cinder-volume[83077]: DEBUG oslo_service.periodic_task [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83077) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 12:33:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:58 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:33:58 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:58 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8649b03b-cf41-4cde-b43c-3b0100c807da tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.890da048-6c17-4dfe-8b92-4cfcde4f75f8" returned: 0 in 0.576s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8649b03b-cf41-4cde-b43c-3b0100c807da tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.890da048-6c17-4dfe-8b92-4cfcde4f75f8 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:58 devstack sudo[89154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.890da048-6c17-4dfe-8b92-4cfcde4f75f8 Feb 27 12:33:58 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:59 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.488s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:59 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8649b03b-cf41-4cde-b43c-3b0100c807da tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d.890da048-6c17-4dfe-8b92-4cfcde4f75f8" returned: 0 in 0.467s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8649b03b-cf41-4cde-b43c-3b0100c807da tempest-VolumeDependencyTests-452734889 None] Lock "cinder-quobyte-890da048-6c17-4dfe-8b92-4cfcde4f75f8" released by "_delete_snapshot" :: held 2.239s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8649b03b-cf41-4cde-b43c-3b0100c807da tempest-VolumeDependencyTests-452734889 None] Lock "cinder-quobyte-034cac31-79ed-4000-9bf9-6e7fc6f3101d" released by "delete_snapshot" :: held 2.259s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Flow 'volume_create_manager' (1ee48212-3eec-4aff-8e2e-486220d98c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930fbbc4-8193-494e-913b-faa9cd9e9871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930fbbc4-8193-494e-913b-faa9cd9e9871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1308044181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a365de3-b32e-4b7a-96b5-5b87d8309f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9b06b25e6047a39a4508b0b4ac97d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:59Z,use_quota=True,user_id='cc0a865862044d39ad32cc5fa84e5034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d5ad44-3f83-49cf-9b18-b2add82c5a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d5ad44-3f83-49cf-9b18-b2add82c5a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdc3dc20-495e-41a7-a3cb-9840aabe12a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdc3dc20-495e-41a7-a3cb-9840aabe12a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a365de3-b32e-4b7a-96b5-5b87d8309f9f', 'volume_name': 'volume-7a365de3-b32e-4b7a-96b5-5b87d8309f9f', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6114fe84-662f-4508-82aa-30713828f9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6114fe84-662f-4508-82aa-30713828f9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4372f870-f599-45bc-88c0-e5d35528457f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:59 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Volume 7a365de3-b32e-4b7a-96b5-5b87d8309f9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a365de3-b32e-4b7a-96b5-5b87d8309f9f', 'volume_size': 1} Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1308044181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a365de3-b32e-4b7a-96b5-5b87d8309f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9b06b25e6047a39a4508b0b4ac97d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:59Z,use_quota=True,user_id='cc0a865862044d39ad32cc5fa84e5034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Creating volume 7a365de3-b32e-4b7a-96b5-5b87d8309f9f {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:59 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7a365de3-b32e-4b7a-96b5-5b87d8309f9f 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:59 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7a365de3-b32e-4b7a-96b5-5b87d8309f9f 1073741824 Feb 27 12:33:59 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-8649b03b-cf41-4cde-b43c-3b0100c807da tempest-VolumeDependencyTests-452734889 None] Created reservations ['3d9b1f29-f8a6-478f-a4ac-d6c68c903698', '4f3efbf8-d9ee-47d9-811b-9f11eb72ae58', '1bdd4fa0-a789-422d-8287-0a50b91c435d', 'a6427925-1f09-46eb-a365-1e3bda8d92aa'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:59 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-8649b03b-cf41-4cde-b43c-3b0100c807da tempest-VolumeDependencyTests-452734889 None] Delete snapshot completed successfully. Feb 27 12:33:59 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8649b03b-cf41-4cde-b43c-3b0100c807da tempest-VolumeDependencyTests-452734889 None] Lock "cinder-890da048-6c17-4dfe-8b92-4cfcde4f75f8-delete_snapshot" released by "delete_snapshot" :: held 2.429s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:00 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7a365de3-b32e-4b7a-96b5-5b87d8309f9f 1073741824" returned: 0 in 0.506s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7a365de3-b32e-4b7a-96b5-5b87d8309f9f {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:00 devstack sudo[89162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7a365de3-b32e-4b7a-96b5-5b87d8309f9f Feb 27 12:34:00 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:00 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-95f930a2-8858-4e8b-bd70-386413cae7c0 tempest-VolumeDependencyTests-452734889 None] Acquiring lock "cinder-034cac31-79ed-4000-9bf9-6e7fc6f3101d-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:00 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-95f930a2-8858-4e8b-bd70-386413cae7c0 tempest-VolumeDependencyTests-452734889 None] Lock "cinder-034cac31-79ed-4000-9bf9-6e7fc6f3101d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:00 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-95f930a2-8858-4e8b-bd70-386413cae7c0 tempest-VolumeDependencyTests-452734889 None] Acquiring lock "cinder-quobyte-034cac31-79ed-4000-9bf9-6e7fc6f3101d" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:00 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-95f930a2-8858-4e8b-bd70-386413cae7c0 tempest-VolumeDependencyTests-452734889 None] Lock "cinder-quobyte-034cac31-79ed-4000-9bf9-6e7fc6f3101d" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:00 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ee16ba-7da6-4c8b-8d13-ee3acccf5837]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-95f930a2-8858-4e8b-bd70-386413cae7c0 tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:00 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7a365de3-b32e-4b7a-96b5-5b87d8309f9f" returned: 0 in 0.417s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:00 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:34:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:00 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4372f870-f599-45bc-88c0-e5d35528457f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a365de3-b32e-4b7a-96b5-5b87d8309f9f', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:00 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57a9f1c-fba1-47f4-ad78-baa0fa4ab843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:00 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Volume volume-7a365de3-b32e-4b7a-96b5-5b87d8309f9f (7a365de3-b32e-4b7a-96b5-5b87d8309f9f): created successfully Feb 27 12:34:00 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57a9f1c-fba1-47f4-ad78-baa0fa4ab843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:00 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Flow 'volume_create_manager' (1ee48212-3eec-4aff-8e2e-486220d98c39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:00 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-dfe19560-989e-44bf-97a3-af42fb6b97ac tempest-VolumesTransfersV355Test-1712754825 None] Created volume successfully. Feb 27 12:34:00 devstack sudo[89165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d Feb 27 12:34:00 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:00 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-95f930a2-8858-4e8b-bd70-386413cae7c0 tempest-VolumeDependencyTests-452734889 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d" returned: 0 in 0.533s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-95f930a2-8858-4e8b-bd70-386413cae7c0 tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:00 devstack sudo[89171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d Feb 27 12:34:00 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:01 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-95f930a2-8858-4e8b-bd70-386413cae7c0 tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-034cac31-79ed-4000-9bf9-6e7fc6f3101d" returned: 0 in 0.421s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:01 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-95f930a2-8858-4e8b-bd70-386413cae7c0 tempest-VolumeDependencyTests-452734889 None] Lock "cinder-quobyte-034cac31-79ed-4000-9bf9-6e7fc6f3101d" released by "delete_volume" :: held 0.991s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:01 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-95f930a2-8858-4e8b-bd70-386413cae7c0 tempest-VolumeDependencyTests-452734889 None] Created reservations ['bfa90120-ab57-47df-9010-73dbff50204e', '56241100-caea-4ebf-b316-e90ff08d1490', 'd1c7a59c-e250-4725-9676-473d56cdbf9b', '9f749e05-b48c-46ab-82ef-615bda4932ea'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-95f930a2-8858-4e8b-bd70-386413cae7c0 tempest-VolumeDependencyTests-452734889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-95f930a2-8858-4e8b-bd70-386413cae7c0 tempest-VolumeDependencyTests-452734889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:01 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-95f930a2-8858-4e8b-bd70-386413cae7c0 tempest-VolumeDependencyTests-452734889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:01 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-95f930a2-8858-4e8b-bd70-386413cae7c0 tempest-VolumeDependencyTests-452734889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-95f930a2-8858-4e8b-bd70-386413cae7c0 tempest-VolumeDependencyTests-452734889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-95f930a2-8858-4e8b-bd70-386413cae7c0 tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:01 devstack sudo[89174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:34:01 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:02 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-95f930a2-8858-4e8b-bd70-386413cae7c0 tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.531s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:02 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-95f930a2-8858-4e8b-bd70-386413cae7c0 tempest-VolumeDependencyTests-452734889 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:34:02 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-95f930a2-8858-4e8b-bd70-386413cae7c0 tempest-VolumeDependencyTests-452734889 None] Deleted volume successfully. Feb 27 12:34:02 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-95f930a2-8858-4e8b-bd70-386413cae7c0 tempest-VolumeDependencyTests-452734889 None] Lock "cinder-034cac31-79ed-4000-9bf9-6e7fc6f3101d-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:02 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-fc678f1e-6f38-4273-b845-387be5b41ba0 tempest-VolumesTransfersV355Test-2020064708 None] Transfer volume completed successfully. Feb 27 12:34:02 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:34:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Flow 'volume_create_manager' (bd6c9d3c-411a-4916-ab90-0217c88a8378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35077908-c331-4971-9787-22461b6f6cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35077908-c331-4971-9787-22461b6f6cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1122499146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad41e9d-90ba-4853-ae98-6a6594be8c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b863a2fa783048bc939a7e0c4c6ddfbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:03Z,use_quota=True,user_id='d17e1bf5a2aa4e6abde46fbaab53abbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f8914f-3a31-482a-964e-fb37a4f5b63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f8914f-3a31-482a-964e-fb37a4f5b63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1549311-5877-4d1f-9972-0962dea91028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1549311-5877-4d1f-9972-0962dea91028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fad41e9d-90ba-4853-ae98-6a6594be8c2e', 'volume_name': 'volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360db6ef-4328-489c-97c3-73773f91f393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360db6ef-4328-489c-97c3-73773f91f393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deee6e30-1e4f-4e41-b4d7-2c02475d8477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:02 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Volume fad41e9d-90ba-4853-ae98-6a6594be8c2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e', 'volume_size': 1} Feb 27 12:34:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:02 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1122499146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad41e9d-90ba-4853-ae98-6a6594be8c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b863a2fa783048bc939a7e0c4c6ddfbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:03Z,use_quota=True,user_id='d17e1bf5a2aa4e6abde46fbaab53abbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:34:02 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Creating volume fad41e9d-90ba-4853-ae98-6a6594be8c2e {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:34:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:02 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:02 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:02 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:34:02 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:34:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:02 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e 1073741824 Feb 27 12:34:02 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5014cfa5-6f46-4a77-9388-2d11fbe3c6d3 tempest-VolumesTransfersV355Test-1711419761 None] Acquiring lock "cinder-7a365de3-b32e-4b7a-96b5-5b87d8309f9f-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5014cfa5-6f46-4a77-9388-2d11fbe3c6d3 tempest-VolumesTransfersV355Test-1711419761 None] Lock "cinder-7a365de3-b32e-4b7a-96b5-5b87d8309f9f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5014cfa5-6f46-4a77-9388-2d11fbe3c6d3 tempest-VolumesTransfersV355Test-1711419761 None] Acquiring lock "cinder-quobyte-7a365de3-b32e-4b7a-96b5-5b87d8309f9f" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5014cfa5-6f46-4a77-9388-2d11fbe3c6d3 tempest-VolumesTransfersV355Test-1711419761 None] Lock "cinder-quobyte-7a365de3-b32e-4b7a-96b5-5b87d8309f9f" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:03 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38d383e-848f-4e89-a1eb-9b32ec0a3ff2]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5014cfa5-6f46-4a77-9388-2d11fbe3c6d3 tempest-VolumesTransfersV355Test-1711419761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7a365de3-b32e-4b7a-96b5-5b87d8309f9f {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:03 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7a365de3-b32e-4b7a-96b5-5b87d8309f9f Feb 27 12:34:03 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:03 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e 1073741824" returned: 0 in 0.621s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:03 devstack sudo[89187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e Feb 27 12:34:03 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:03 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5014cfa5-6f46-4a77-9388-2d11fbe3c6d3 tempest-VolumesTransfersV355Test-1711419761 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7a365de3-b32e-4b7a-96b5-5b87d8309f9f" returned: 0 in 0.528s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5014cfa5-6f46-4a77-9388-2d11fbe3c6d3 tempest-VolumesTransfersV355Test-1711419761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7a365de3-b32e-4b7a-96b5-5b87d8309f9f {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:03 devstack sudo[89189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7a365de3-b32e-4b7a-96b5-5b87d8309f9f Feb 27 12:34:03 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:04 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e" returned: 0 in 0.454s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deee6e30-1e4f-4e41-b4d7-2c02475d8477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20051d7b-9297-496e-b22f-d9ae54beaf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:04 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Volume volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e (fad41e9d-90ba-4853-ae98-6a6594be8c2e): created successfully Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20051d7b-9297-496e-b22f-d9ae54beaf8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Flow 'volume_create_manager' (bd6c9d3c-411a-4916-ab90-0217c88a8378) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:04 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-6c767048-bbc1-4aa3-a876-cf495344799f tempest-VolumeDependencyTests-452734889 None] Created volume successfully. Feb 27 12:34:04 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5014cfa5-6f46-4a77-9388-2d11fbe3c6d3 tempest-VolumesTransfersV355Test-1711419761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7a365de3-b32e-4b7a-96b5-5b87d8309f9f" returned: 0 in 0.471s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5014cfa5-6f46-4a77-9388-2d11fbe3c6d3 tempest-VolumesTransfersV355Test-1711419761 None] Lock "cinder-quobyte-7a365de3-b32e-4b7a-96b5-5b87d8309f9f" released by "delete_volume" :: held 1.036s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-5014cfa5-6f46-4a77-9388-2d11fbe3c6d3 tempest-VolumesTransfersV355Test-1711419761 None] Created reservations ['d3bc1881-aa85-4e80-bdc1-85ee7b419b98', 'e20c0ff0-424b-4763-b715-30ac19d6bc7b', 'd0ae39b2-e2f2-45d6-8b01-3e1296a7d158', 'c45dd066-05f9-4edb-be96-97b3dcabe006'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Flow 'volume_create_manager' (162c7443-5ace-4fd4-9752-ecbc82d857cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c2950e-0183-4c46-80ae-07cdd7fa4aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c2950e-0183-4c46-80ae-07cdd7fa4aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2136381957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a05df7-a2c9-4b8d-90a7-86059615c030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba790d203905488ea3ae022de788c996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:04Z,use_quota=True,user_id='e05be549b04a4b64a83270b78133a22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcbeb077-d8d1-491d-a9c4-ab50c59a9c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcbeb077-d8d1-491d-a9c4-ab50c59a9c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d35a0e3-ea3d-4db2-8975-c6e3a833b223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d35a0e3-ea3d-4db2-8975-c6e3a833b223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53a05df7-a2c9-4b8d-90a7-86059615c030', 'volume_name': 'volume-53a05df7-a2c9-4b8d-90a7-86059615c030', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3cc37e8-22f6-43d6-91d7-9d6368ceea93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3cc37e8-22f6-43d6-91d7-9d6368ceea93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7710e465-8a11-4eba-90b1-1410c049cd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:04 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Volume 53a05df7-a2c9-4b8d-90a7-86059615c030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53a05df7-a2c9-4b8d-90a7-86059615c030', 'volume_size': 1} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2136381957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a05df7-a2c9-4b8d-90a7-86059615c030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba790d203905488ea3ae022de788c996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:04Z,use_quota=True,user_id='e05be549b04a4b64a83270b78133a22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Creating volume 53a05df7-a2c9-4b8d-90a7-86059615c030 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:34:04 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-53a05df7-a2c9-4b8d-90a7-86059615c030 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-5014cfa5-6f46-4a77-9388-2d11fbe3c6d3 tempest-VolumesTransfersV355Test-1711419761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-5014cfa5-6f46-4a77-9388-2d11fbe3c6d3 tempest-VolumesTransfersV355Test-1711419761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-5014cfa5-6f46-4a77-9388-2d11fbe3c6d3 tempest-VolumesTransfersV355Test-1711419761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-5014cfa5-6f46-4a77-9388-2d11fbe3c6d3 tempest-VolumesTransfersV355Test-1711419761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-5014cfa5-6f46-4a77-9388-2d11fbe3c6d3 tempest-VolumesTransfersV355Test-1711419761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5014cfa5-6f46-4a77-9388-2d11fbe3c6d3 tempest-VolumesTransfersV355Test-1711419761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:04 devstack sudo[89193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-53a05df7-a2c9-4b8d-90a7-86059615c030 1073741824 Feb 27 12:34:04 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:04 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:34:04 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:04 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5014cfa5-6f46-4a77-9388-2d11fbe3c6d3 tempest-VolumesTransfersV355Test-1711419761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.436s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-5014cfa5-6f46-4a77-9388-2d11fbe3c6d3 tempest-VolumesTransfersV355Test-1711419761 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:34:04 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-5014cfa5-6f46-4a77-9388-2d11fbe3c6d3 tempest-VolumesTransfersV355Test-1711419761 None] Deleted volume successfully. Feb 27 12:34:04 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-53a05df7-a2c9-4b8d-90a7-86059615c030 1073741824" returned: 0 in 0.465s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-53a05df7-a2c9-4b8d-90a7-86059615c030 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5014cfa5-6f46-4a77-9388-2d11fbe3c6d3 tempest-VolumesTransfersV355Test-1711419761 None] Lock "cinder-7a365de3-b32e-4b7a-96b5-5b87d8309f9f-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:04 devstack sudo[89201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-53a05df7-a2c9-4b8d-90a7-86059615c030 Feb 27 12:34:04 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:34:05 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Flow 'volume_create_manager' (793e23db-34fe-4e3e-83fb-fec8bf3bc706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c05f1f3a-0dfa-4b9a-8671-ecd2f3f1612e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c05f1f3a-0dfa-4b9a-8671-ecd2f3f1612e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-940026335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5c2b795-cc81-43ca-9220-9745ddd3e5c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b863a2fa783048bc939a7e0c4c6ddfbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=fad41e9d-90ba-4853-ae98-6a6594be8c2e,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:05Z,use_quota=True,user_id='d17e1bf5a2aa4e6abde46fbaab53abbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01cc7c98-bf09-43d0-b9f0-72f4504fd053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01cc7c98-bf09-43d0-b9f0-72f4504fd053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbeadc72-f737-4da0-81b1-29550c47313f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbeadc72-f737-4da0-81b1-29550c47313f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f5c2b795-cc81-43ca-9220-9745ddd3e5c9', 'volume_name': 'volume-f5c2b795-cc81-43ca-9220-9745ddd3e5c9', 'volume_size': 1, 'source_volid': 'fad41e9d-90ba-4853-ae98-6a6594be8c2e', 'source_volstatus': 'available'}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa48547-cf48-40c8-bd1e-7b8cd82ab639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa48547-cf48-40c8-bd1e-7b8cd82ab639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd283ad3-e9c8-47cf-a694-38d86ac622c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:05 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Volume f5c2b795-cc81-43ca-9220-9745ddd3e5c9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f5c2b795-cc81-43ca-9220-9745ddd3e5c9', 'volume_size': 1, 'source_volid': 'fad41e9d-90ba-4853-ae98-6a6594be8c2e', 'source_volstatus': 'available'} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-53a05df7-a2c9-4b8d-90a7-86059615c030" returned: 0 in 0.575s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:05 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Cloning volume fad41e9d-90ba-4853-ae98-6a6594be8c2e to volume f5c2b795-cc81-43ca-9220-9745ddd3e5c9 Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7710e465-8a11-4eba-90b1-1410c049cd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53a05df7-a2c9-4b8d-90a7-86059615c030', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467d40dc-902b-40ac-aba2-b3f772d842f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Creating offline snapshot 2e95dbb2-c30d-41aa-bd5d-88faea0b8b92 of volume fad41e9d-90ba-4853-ae98-6a6594be8c2e {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:34:05 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Volume volume-53a05df7-a2c9-4b8d-90a7-86059615c030 (53a05df7-a2c9-4b8d-90a7-86059615c030): created successfully Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467d40dc-902b-40ac-aba2-b3f772d842f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Flow 'volume_create_manager' (162c7443-5ace-4fd4-9752-ecbc82d857cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[af102df8-c4ac-482b-bf4e-40bd64085bd0]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:05 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-beaf6a6c-dffd-41b1-b702-cd2903241e6a tempest-VolumesListAdminTestJSON-754476091 None] Created volume successfully. Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Flow 'volume_create_manager' (969b9d29-7c7c-4e79-9192-950a1803e34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ed51c5-8149-4aa7-ae55-39fa5d2a2a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ed51c5-8149-4aa7-ae55-39fa5d2a2a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1918512298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=312bb5d6-d9e6-4124-bb64-4ec3762ca4b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9b06b25e6047a39a4508b0b4ac97d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:05Z,use_quota=True,user_id='cc0a865862044d39ad32cc5fa84e5034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:05 devstack sudo[89204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32222aeb-089f-4856-b64e-9e1ab00470ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:05 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32222aeb-089f-4856-b64e-9e1ab00470ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0abca7-e090-4fc5-b444-937ae29aeb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0abca7-e090-4fc5-b444-937ae29aeb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '312bb5d6-d9e6-4124-bb64-4ec3762ca4b0', 'volume_name': 'volume-312bb5d6-d9e6-4124-bb64-4ec3762ca4b0', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (055d3c71-6289-496f-adac-0c8b546e90de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (055d3c71-6289-496f-adac-0c8b546e90de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c5a82e-a3d8-40b0-86ea-7b7fe9a81081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:05 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Volume 312bb5d6-d9e6-4124-bb64-4ec3762ca4b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-312bb5d6-d9e6-4124-bb64-4ec3762ca4b0', 'volume_size': 1} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:05 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e" returned: 0 in 0.481s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.2e95dbb2-c30d-41aa-bd5d-88faea0b8b92 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:05 devstack sudo[89209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.2e95dbb2-c30d-41aa-bd5d-88faea0b8b92 1G Feb 27 12:34:05 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:06 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.2e95dbb2-c30d-41aa-bd5d-88faea0b8b92 1G" returned: 0 in 0.512s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.2e95dbb2-c30d-41aa-bd5d-88faea0b8b92 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:06 devstack sudo[89214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.2e95dbb2-c30d-41aa-bd5d-88faea0b8b92 Feb 27 12:34:06 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:06 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:34:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Flow 'volume_create_manager' (3ef03792-c3e6-45f4-8929-aea0d016f289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e5031f9-943f-4d23-982e-9d7468305df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e5031f9-943f-4d23-982e-9d7468305df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2126612300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e65377-3c95-4106-b18d-c505ee091e40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba790d203905488ea3ae022de788c996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:07Z,use_quota=True,user_id='e05be549b04a4b64a83270b78133a22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70fff44-3d6a-4100-b3d8-83f3f3bc2ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70fff44-3d6a-4100-b3d8-83f3f3bc2ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef93353c-b3ea-4356-9d2f-30b98e6e7c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef93353c-b3ea-4356-9d2f-30b98e6e7c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14e65377-3c95-4106-b18d-c505ee091e40', 'volume_name': 'volume-14e65377-3c95-4106-b18d-c505ee091e40', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e97466-4bb9-4a21-afc2-2e1756f2a8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e97466-4bb9-4a21-afc2-2e1756f2a8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ebcb022-04c4-42c6-8520-976869b78e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:06 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Volume 14e65377-3c95-4106-b18d-c505ee091e40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14e65377-3c95-4106-b18d-c505ee091e40', 'volume_size': 1} Feb 27 12:34:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:06 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.2e95dbb2-c30d-41aa-bd5d-88faea0b8b92" returned: 0 in 0.422s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:06 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.2e95dbb2-c30d-41aa-bd5d-88faea0b8b92 is being set with open permissions: ugo+rw Feb 27 12:34:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.2e95dbb2-c30d-41aa-bd5d-88faea0b8b92 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:06 devstack sudo[89219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.2e95dbb2-c30d-41aa-bd5d-88faea0b8b92 Feb 27 12:34:06 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:07 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.2e95dbb2-c30d-41aa-bd5d-88faea0b8b92" returned: 0 in 0.372s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:07 devstack sudo[89222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.info Feb 27 12:34:07 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:07 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.info" returned: 0 in 0.393s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:07 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.info is being set with open permissions: ugo+rw Feb 27 12:34:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:07 devstack sudo[89225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.info Feb 27 12:34:07 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:07 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.info" returned: 0 in 0.383s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Acquiring lock "cinder-quobyte-f5c2b795-cc81-43ca-9220-9745ddd3e5c9" by "_copy_volume_from_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Lock "cinder-quobyte-f5c2b795-cc81-43ca-9220-9745ddd3e5c9" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:07 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] snapshot: 2e95dbb2-c30d-41aa-bd5d-88faea0b8b92, volume: f5c2b795-cc81-43ca-9220-9745ddd3e5c9, {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 12:34:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:07 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:08 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:08 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d8296e-ab92-4bad-8ed8-230e26ad271c]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.2e95dbb2-c30d-41aa-bd5d-88faea0b8b92 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:08 devstack sudo[89228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.2e95dbb2-c30d-41aa-bd5d-88faea0b8b92 Feb 27 12:34:08 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:08 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.2e95dbb2-c30d-41aa-bd5d-88faea0b8b92" returned: 0 in 0.458s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:08 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:34:08 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 12:34:08 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Creating direct copy from snapshot {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 12:34:08 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a895b8-c783-4675-b179-b93c3af6bf9a]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:08 devstack sudo[89233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e Feb 27 12:34:08 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:08 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e" returned: 0 in 0.449s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:08 devstack cinder-volume[83077]: DEBUG cinder.utils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Path /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f5c2b795-cc81-43ca-9220-9745ddd3e5c9 not found in is_blk_device check {{(pid=83077) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 12:34:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f5c2b795-cc81-43ca-9220-9745ddd3e5c9 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:08 devstack sudo[89238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f5c2b795-cc81-43ca-9220-9745ddd3e5c9 Feb 27 12:34:08 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:10 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f5c2b795-cc81-43ca-9220-9745ddd3e5c9" returned: 0 in 1.852s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:10 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4173387-4689-443d-b01a-25f776c683a3]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:10 devstack sudo[89250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e Feb 27 12:34:10 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:11 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e" returned: 0 in 0.564s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:11 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Image conversion details: src /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e, size 1024.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f5c2b795-cc81-43ca-9220-9745ddd3e5c9 {{(pid=83077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:34:11 devstack cinder-volume[83077]: INFO cinder.image.image_utils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Converted 1024.00 MB image at 552.59 MB/s Feb 27 12:34:11 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f5c2b795-cc81-43ca-9220-9745ddd3e5c9 is being set with open permissions: ugo+rw Feb 27 12:34:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f5c2b795-cc81-43ca-9220-9745ddd3e5c9 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:11 devstack sudo[89256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f5c2b795-cc81-43ca-9220-9745ddd3e5c9 Feb 27 12:34:11 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:11 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f5c2b795-cc81-43ca-9220-9745ddd3e5c9" returned: 0 in 0.397s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:11 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Lock "cinder-quobyte-f5c2b795-cc81-43ca-9220-9745ddd3e5c9" released by "_copy_volume_from_snapshot" :: held 3.761s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:11 devstack cinder-volume[83077]: DEBUG dbcounter [-] [83077] Writing DB stats cinder:UPDATE=224,cinder:SELECT=192,cinder:INSERT=84,cinder:DELETE=19 {{(pid=83077) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:34:11 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Acquiring lock "cinder-quobyte-2e95dbb2-c30d-41aa-bd5d-88faea0b8b92" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:11 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Lock "cinder-quobyte-2e95dbb2-c30d-41aa-bd5d-88faea0b8b92" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:11 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Deleting offline snapshot 2e95dbb2-c30d-41aa-bd5d-88faea0b8b92 of volume fad41e9d-90ba-4853-ae98-6a6594be8c2e {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:34:11 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] snapshot_file for this snap is: volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.2e95dbb2-c30d-41aa-bd5d-88faea0b8b92 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:34:11 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c03f19c-780b-4764-81df-591286162bc3]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.2e95dbb2-c30d-41aa-bd5d-88faea0b8b92 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:11 devstack sudo[89259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.2e95dbb2-c30d-41aa-bd5d-88faea0b8b92 Feb 27 12:34:11 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:12 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.2e95dbb2-c30d-41aa-bd5d-88faea0b8b92" returned: 0 in 0.473s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:12 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:34:12 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a5baa0-0e3d-4fde-a754-c430d48d4f82]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:12 devstack sudo[89264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e Feb 27 12:34:12 devstack sudo[89264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:12 devstack sudo[89264]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e" returned: 0 in 0.468s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.2e95dbb2-c30d-41aa-bd5d-88faea0b8b92 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:12 devstack sudo[89269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.2e95dbb2-c30d-41aa-bd5d-88faea0b8b92 Feb 27 12:34:12 devstack sudo[89269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:13 devstack sudo[89269]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.2e95dbb2-c30d-41aa-bd5d-88faea0b8b92" returned: 0 in 0.428s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.2e95dbb2-c30d-41aa-bd5d-88faea0b8b92 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:13 devstack sudo[89274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.2e95dbb2-c30d-41aa-bd5d-88faea0b8b92 Feb 27 12:34:13 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:13 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e.2e95dbb2-c30d-41aa-bd5d-88faea0b8b92" returned: 0 in 0.380s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:13 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Lock "cinder-quobyte-2e95dbb2-c30d-41aa-bd5d-88faea0b8b92" released by "_delete_snapshot" :: held 1.794s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.257s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.067s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:13 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1918512298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=312bb5d6-d9e6-4124-bb64-4ec3762ca4b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9b06b25e6047a39a4508b0b4ac97d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:05Z,use_quota=True,user_id='cc0a865862044d39ad32cc5fa84e5034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:34:13 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Creating volume 312bb5d6-d9e6-4124-bb64-4ec3762ca4b0 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:34:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:13 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:13 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:13 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:34:13 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:34:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-312bb5d6-d9e6-4124-bb64-4ec3762ca4b0 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd283ad3-e9c8-47cf-a694-38d86ac622c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5c2b795-cc81-43ca-9220-9745ddd3e5c9', 'volume_size': 1, 'source_volid': 'fad41e9d-90ba-4853-ae98-6a6594be8c2e', 'source_volstatus': 'available'}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:13 devstack sudo[89277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-312bb5d6-d9e6-4124-bb64-4ec3762ca4b0 1073741824 Feb 27 12:34:13 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e1d584-d569-427c-95f8-b12186d07393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:13 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Volume volume-f5c2b795-cc81-43ca-9220-9745ddd3e5c9 (f5c2b795-cc81-43ca-9220-9745ddd3e5c9): created successfully Feb 27 12:34:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e1d584-d569-427c-95f8-b12186d07393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Flow 'volume_create_manager' (793e23db-34fe-4e3e-83fb-fec8bf3bc706) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:13 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-12786e98-91d4-4dd9-bde8-2f80e91dd50f tempest-VolumeDependencyTests-452734889 None] Created volume successfully. Feb 27 12:34:14 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-312bb5d6-d9e6-4124-bb64-4ec3762ca4b0 1073741824" returned: 0 in 0.471s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-312bb5d6-d9e6-4124-bb64-4ec3762ca4b0 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:14 devstack sudo[89282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-312bb5d6-d9e6-4124-bb64-4ec3762ca4b0 Feb 27 12:34:14 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:14 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-312bb5d6-d9e6-4124-bb64-4ec3762ca4b0" returned: 0 in 0.379s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:14 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:34:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.805s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:14 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2126612300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e65377-3c95-4106-b18d-c505ee091e40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba790d203905488ea3ae022de788c996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:07Z,use_quota=True,user_id='e05be549b04a4b64a83270b78133a22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:34:14 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Creating volume 14e65377-3c95-4106-b18d-c505ee091e40 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:34:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:14 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:14 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:14 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:34:14 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:34:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-14e65377-3c95-4106-b18d-c505ee091e40 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:14 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c5a82e-a3d8-40b0-86ea-7b7fe9a81081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-312bb5d6-d9e6-4124-bb64-4ec3762ca4b0', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:14 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b97cad-610f-48d4-b928-4231190d6f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:14 devstack sudo[89285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-14e65377-3c95-4106-b18d-c505ee091e40 1073741824 Feb 27 12:34:14 devstack sudo[89285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:14 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Volume volume-312bb5d6-d9e6-4124-bb64-4ec3762ca4b0 (312bb5d6-d9e6-4124-bb64-4ec3762ca4b0): created successfully Feb 27 12:34:14 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b97cad-610f-48d4-b928-4231190d6f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:14 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Flow 'volume_create_manager' (969b9d29-7c7c-4e79-9192-950a1803e34c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:14 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-0b890135-7542-49b6-9627-37b2903b9b98 tempest-VolumesTransfersV355Test-1712754825 None] Created volume successfully. Feb 27 12:34:14 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-c9b44b41-4700-4cc7-92e2-bd41ee544a59 tempest-VolumeDependencyTests-452734889 None] Acquiring lock "cinder-fad41e9d-90ba-4853-ae98-6a6594be8c2e-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:14 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-c9b44b41-4700-4cc7-92e2-bd41ee544a59 tempest-VolumeDependencyTests-452734889 None] Lock "cinder-fad41e9d-90ba-4853-ae98-6a6594be8c2e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:14 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-c9b44b41-4700-4cc7-92e2-bd41ee544a59 tempest-VolumeDependencyTests-452734889 None] Acquiring lock "cinder-quobyte-fad41e9d-90ba-4853-ae98-6a6594be8c2e" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:14 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-c9b44b41-4700-4cc7-92e2-bd41ee544a59 tempest-VolumeDependencyTests-452734889 None] Lock "cinder-quobyte-fad41e9d-90ba-4853-ae98-6a6594be8c2e" acquired by "delete_volume" :: waited 0.006s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:14 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[524fc3a9-a72b-4238-9bea-3b14479435d5]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c9b44b41-4700-4cc7-92e2-bd41ee544a59 tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:14 devstack sudo[89287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e Feb 27 12:34:14 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:14 devstack sudo[89285]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-14e65377-3c95-4106-b18d-c505ee091e40 1073741824" returned: 0 in 0.493s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-14e65377-3c95-4106-b18d-c505ee091e40 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:15 devstack sudo[89292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-14e65377-3c95-4106-b18d-c505ee091e40 Feb 27 12:34:15 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:15 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c9b44b41-4700-4cc7-92e2-bd41ee544a59 tempest-VolumeDependencyTests-452734889 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e" returned: 0 in 0.481s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c9b44b41-4700-4cc7-92e2-bd41ee544a59 tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bfaea221-1df8-466d-af1a-84a70967fb20 tempest-VolumesTransfersV355Test-1711419761 None] Acquiring lock "cinder-312bb5d6-d9e6-4124-bb64-4ec3762ca4b0-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:15 devstack sudo[89297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e Feb 27 12:34:15 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bfaea221-1df8-466d-af1a-84a70967fb20 tempest-VolumesTransfersV355Test-1711419761 None] Lock "cinder-312bb5d6-d9e6-4124-bb64-4ec3762ca4b0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bfaea221-1df8-466d-af1a-84a70967fb20 tempest-VolumesTransfersV355Test-1711419761 None] Acquiring lock "cinder-quobyte-312bb5d6-d9e6-4124-bb64-4ec3762ca4b0" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bfaea221-1df8-466d-af1a-84a70967fb20 tempest-VolumesTransfersV355Test-1711419761 None] Lock "cinder-quobyte-312bb5d6-d9e6-4124-bb64-4ec3762ca4b0" acquired by "delete_volume" :: waited 0.007s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[1950cc3c-aa75-483a-8fbd-445e9ab1081d]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bfaea221-1df8-466d-af1a-84a70967fb20 tempest-VolumesTransfersV355Test-1711419761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-312bb5d6-d9e6-4124-bb64-4ec3762ca4b0 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:15 devstack sudo[89299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-312bb5d6-d9e6-4124-bb64-4ec3762ca4b0 Feb 27 12:34:15 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:15 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-14e65377-3c95-4106-b18d-c505ee091e40" returned: 0 in 0.432s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ebcb022-04c4-42c6-8520-976869b78e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14e65377-3c95-4106-b18d-c505ee091e40', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e316097f-d8e3-42b7-91c7-10e0dbd514e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:15 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Volume volume-14e65377-3c95-4106-b18d-c505ee091e40 (14e65377-3c95-4106-b18d-c505ee091e40): created successfully Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e316097f-d8e3-42b7-91c7-10e0dbd514e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Flow 'volume_create_manager' (3ef03792-c3e6-45f4-8929-aea0d016f289) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:15 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-f988b4ac-7640-4d98-a8c4-a51a55bf2aba tempest-VolumesListAdminTestJSON-754476091 None] Created volume successfully. Feb 27 12:34:15 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c9b44b41-4700-4cc7-92e2-bd41ee544a59 tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fad41e9d-90ba-4853-ae98-6a6594be8c2e" returned: 0 in 0.425s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-c9b44b41-4700-4cc7-92e2-bd41ee544a59 tempest-VolumeDependencyTests-452734889 None] Lock "cinder-quobyte-fad41e9d-90ba-4853-ae98-6a6594be8c2e" released by "delete_volume" :: held 0.936s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-c9b44b41-4700-4cc7-92e2-bd41ee544a59 tempest-VolumeDependencyTests-452734889 None] Created reservations ['2f300f81-7622-4f6b-8acf-05af2be85bdc', 'b9c9776a-b27b-47e5-bdb0-a01e1c9b9527', 'ae4c0f71-c088-4d85-969d-88a163de372a', 'cc851bcf-0786-42f7-9666-4521eaf85747'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c9b44b41-4700-4cc7-92e2-bd41ee544a59 tempest-VolumeDependencyTests-452734889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c9b44b41-4700-4cc7-92e2-bd41ee544a59 tempest-VolumeDependencyTests-452734889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c9b44b41-4700-4cc7-92e2-bd41ee544a59 tempest-VolumeDependencyTests-452734889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-c9b44b41-4700-4cc7-92e2-bd41ee544a59 tempest-VolumeDependencyTests-452734889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-c9b44b41-4700-4cc7-92e2-bd41ee544a59 tempest-VolumeDependencyTests-452734889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c9b44b41-4700-4cc7-92e2-bd41ee544a59 tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:15 devstack sudo[89306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:34:15 devstack sudo[89306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-e8cea0a2-8405-4e1e-ba41-62e07c36b121 tempest-VolumeDependencyTests-452734889 None] Acquiring lock "cinder-f5c2b795-cc81-43ca-9220-9745ddd3e5c9-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:15 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-e8cea0a2-8405-4e1e-ba41-62e07c36b121 tempest-VolumeDependencyTests-452734889 None] Lock "cinder-f5c2b795-cc81-43ca-9220-9745ddd3e5c9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bfaea221-1df8-466d-af1a-84a70967fb20 tempest-VolumesTransfersV355Test-1711419761 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-312bb5d6-d9e6-4124-bb64-4ec3762ca4b0" returned: 0 in 0.520s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bfaea221-1df8-466d-af1a-84a70967fb20 tempest-VolumesTransfersV355Test-1711419761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-312bb5d6-d9e6-4124-bb64-4ec3762ca4b0 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:15 devstack sudo[89308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-312bb5d6-d9e6-4124-bb64-4ec3762ca4b0 Feb 27 12:34:15 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-e8cea0a2-8405-4e1e-ba41-62e07c36b121 tempest-VolumeDependencyTests-452734889 None] Acquiring lock "cinder-quobyte-f5c2b795-cc81-43ca-9220-9745ddd3e5c9" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-e8cea0a2-8405-4e1e-ba41-62e07c36b121 tempest-VolumeDependencyTests-452734889 None] Lock "cinder-quobyte-f5c2b795-cc81-43ca-9220-9745ddd3e5c9" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b43cbe0-d5c0-4f80-8237-b3f4707dc0d4]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e8cea0a2-8405-4e1e-ba41-62e07c36b121 tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f5c2b795-cc81-43ca-9220-9745ddd3e5c9 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:15 devstack sudo[89310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f5c2b795-cc81-43ca-9220-9745ddd3e5c9 Feb 27 12:34:15 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:16 devstack sudo[89306]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-c9b44b41-4700-4cc7-92e2-bd41ee544a59 tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.418s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-c9b44b41-4700-4cc7-92e2-bd41ee544a59 tempest-VolumeDependencyTests-452734889 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:34:16 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-c9b44b41-4700-4cc7-92e2-bd41ee544a59 tempest-VolumeDependencyTests-452734889 None] Deleted volume successfully. Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-c9b44b41-4700-4cc7-92e2-bd41ee544a59 tempest-VolumeDependencyTests-452734889 None] Lock "cinder-fad41e9d-90ba-4853-ae98-6a6594be8c2e-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:16 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bfaea221-1df8-466d-af1a-84a70967fb20 tempest-VolumesTransfersV355Test-1711419761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-312bb5d6-d9e6-4124-bb64-4ec3762ca4b0" returned: 0 in 0.435s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bfaea221-1df8-466d-af1a-84a70967fb20 tempest-VolumesTransfersV355Test-1711419761 None] Lock "cinder-quobyte-312bb5d6-d9e6-4124-bb64-4ec3762ca4b0" released by "delete_volume" :: held 0.983s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-bfaea221-1df8-466d-af1a-84a70967fb20 tempest-VolumesTransfersV355Test-1711419761 None] Created reservations ['1b28fe0b-5ae0-44cf-9568-6e9bb9795f0c', 'c9a5797f-01ae-4166-b9f1-f1f87588938d', '624ae7e6-327f-4ed9-910c-01e93f8f370e', '8620b843-9b88-4efc-a7a4-61ecf3d66fdc'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bfaea221-1df8-466d-af1a-84a70967fb20 tempest-VolumesTransfersV355Test-1711419761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bfaea221-1df8-466d-af1a-84a70967fb20 tempest-VolumesTransfersV355Test-1711419761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bfaea221-1df8-466d-af1a-84a70967fb20 tempest-VolumesTransfersV355Test-1711419761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bfaea221-1df8-466d-af1a-84a70967fb20 tempest-VolumesTransfersV355Test-1711419761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bfaea221-1df8-466d-af1a-84a70967fb20 tempest-VolumesTransfersV355Test-1711419761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bfaea221-1df8-466d-af1a-84a70967fb20 tempest-VolumesTransfersV355Test-1711419761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:16 devstack sudo[89317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:34:16 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:16 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e8cea0a2-8405-4e1e-ba41-62e07c36b121 tempest-VolumeDependencyTests-452734889 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f5c2b795-cc81-43ca-9220-9745ddd3e5c9" returned: 0 in 0.523s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e8cea0a2-8405-4e1e-ba41-62e07c36b121 tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f5c2b795-cc81-43ca-9220-9745ddd3e5c9 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:16 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f5c2b795-cc81-43ca-9220-9745ddd3e5c9 Feb 27 12:34:16 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Flow 'volume_create_manager' (43a51784-38fe-4f76-9c2d-632720e72e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (281de447-3ffa-48ac-bd42-153fdbb66afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (281de447-3ffa-48ac-bd42-153fdbb66afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1031369417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=199e0106-3962-41fa-9cba-43990f42f3ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba790d203905488ea3ae022de788c996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:17Z,use_quota=True,user_id='e05be549b04a4b64a83270b78133a22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae0d2f1-ff38-4795-8709-f058000c1b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae0d2f1-ff38-4795-8709-f058000c1b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0920699d-a566-4010-9ce4-608c3a390a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0920699d-a566-4010-9ce4-608c3a390a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '199e0106-3962-41fa-9cba-43990f42f3ef', 'volume_name': 'volume-199e0106-3962-41fa-9cba-43990f42f3ef', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c7580e4-1711-4a1b-b81e-2ec0570ecf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c7580e4-1711-4a1b-b81e-2ec0570ecf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e20e83-abfc-488b-97f7-3e8b8d7e7d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:16 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Volume 199e0106-3962-41fa-9cba-43990f42f3ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-199e0106-3962-41fa-9cba-43990f42f3ef', 'volume_size': 1} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1031369417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=199e0106-3962-41fa-9cba-43990f42f3ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba790d203905488ea3ae022de788c996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:17Z,use_quota=True,user_id='e05be549b04a4b64a83270b78133a22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Creating volume 199e0106-3962-41fa-9cba-43990f42f3ef {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:34:16 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-199e0106-3962-41fa-9cba-43990f42f3ef 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:16 devstack sudo[89321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-199e0106-3962-41fa-9cba-43990f42f3ef 1073741824 Feb 27 12:34:16 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:16 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bfaea221-1df8-466d-af1a-84a70967fb20 tempest-VolumesTransfersV355Test-1711419761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.506s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-bfaea221-1df8-466d-af1a-84a70967fb20 tempest-VolumesTransfersV355Test-1711419761 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:34:16 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-bfaea221-1df8-466d-af1a-84a70967fb20 tempest-VolumesTransfersV355Test-1711419761 None] Deleted volume successfully. Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bfaea221-1df8-466d-af1a-84a70967fb20 tempest-VolumesTransfersV355Test-1711419761 None] Lock "cinder-312bb5d6-d9e6-4124-bb64-4ec3762ca4b0-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:16 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e8cea0a2-8405-4e1e-ba41-62e07c36b121 tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-f5c2b795-cc81-43ca-9220-9745ddd3e5c9" returned: 0 in 0.604s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:16 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-e8cea0a2-8405-4e1e-ba41-62e07c36b121 tempest-VolumeDependencyTests-452734889 None] Lock "cinder-quobyte-f5c2b795-cc81-43ca-9220-9745ddd3e5c9" released by "delete_volume" :: held 1.148s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:17 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-e8cea0a2-8405-4e1e-ba41-62e07c36b121 tempest-VolumeDependencyTests-452734889 None] Created reservations ['4de8593b-937e-426d-8717-85afadf74df4', '4e99c174-826f-4e90-bbc6-431c9fa8c036', 'cbd3e059-526e-47ce-a160-e9c14013477d', '446deba7-241e-4168-a9bd-64b90be70e49'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-e8cea0a2-8405-4e1e-ba41-62e07c36b121 tempest-VolumeDependencyTests-452734889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-e8cea0a2-8405-4e1e-ba41-62e07c36b121 tempest-VolumeDependencyTests-452734889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:17 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-e8cea0a2-8405-4e1e-ba41-62e07c36b121 tempest-VolumeDependencyTests-452734889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:17 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-e8cea0a2-8405-4e1e-ba41-62e07c36b121 tempest-VolumeDependencyTests-452734889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-e8cea0a2-8405-4e1e-ba41-62e07c36b121 tempest-VolumeDependencyTests-452734889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e8cea0a2-8405-4e1e-ba41-62e07c36b121 tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:17 devstack sudo[89328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:34:17 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:17 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-199e0106-3962-41fa-9cba-43990f42f3ef 1073741824" returned: 0 in 0.580s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-199e0106-3962-41fa-9cba-43990f42f3ef {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:17 devstack sudo[89330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-199e0106-3962-41fa-9cba-43990f42f3ef Feb 27 12:34:17 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:17 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e8cea0a2-8405-4e1e-ba41-62e07c36b121 tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.531s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:17 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-e8cea0a2-8405-4e1e-ba41-62e07c36b121 tempest-VolumeDependencyTests-452734889 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:34:17 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-e8cea0a2-8405-4e1e-ba41-62e07c36b121 tempest-VolumeDependencyTests-452734889 None] Deleted volume successfully. Feb 27 12:34:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-e8cea0a2-8405-4e1e-ba41-62e07c36b121 tempest-VolumeDependencyTests-452734889 None] Lock "cinder-f5c2b795-cc81-43ca-9220-9745ddd3e5c9-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:17 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-199e0106-3962-41fa-9cba-43990f42f3ef" returned: 0 in 0.449s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:17 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:34:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e20e83-abfc-488b-97f7-3e8b8d7e7d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-199e0106-3962-41fa-9cba-43990f42f3ef', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa841c4-63f3-4919-8b9d-cd41668c7775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:17 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Volume volume-199e0106-3962-41fa-9cba-43990f42f3ef (199e0106-3962-41fa-9cba-43990f42f3ef): created successfully Feb 27 12:34:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa841c4-63f3-4919-8b9d-cd41668c7775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:17 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Flow 'volume_create_manager' (43a51784-38fe-4f76-9c2d-632720e72e5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:17 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-0a20917e-83a1-43ed-bdb5-9e1eced9df57 tempest-VolumesListAdminTestJSON-754476091 None] Created volume successfully. Feb 27 12:34:18 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a4ab9800-a375-410b-95b0-dd4b42985c70 tempest-VolumeDependencyTests-452734889 None] Acquiring lock "cinder-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:18 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a4ab9800-a375-410b-95b0-dd4b42985c70 tempest-VolumeDependencyTests-452734889 None] Lock "cinder-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:18 devstack cinder-volume[83077]: DEBUG dbcounter [-] [83077] Writing DB stats cinder:SELECT=162,cinder:INSERT=52,cinder:UPDATE=243,cinder:DELETE=18 {{(pid=83077) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:34:18 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a4ab9800-a375-410b-95b0-dd4b42985c70 tempest-VolumeDependencyTests-452734889 None] Acquiring lock "cinder-quobyte-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:18 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a4ab9800-a375-410b-95b0-dd4b42985c70 tempest-VolumeDependencyTests-452734889 None] Lock "cinder-quobyte-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:18 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fc18ad-4c83-49cf-b7b7-0485a8239b92]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a4ab9800-a375-410b-95b0-dd4b42985c70 tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:18 devstack sudo[89334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5 Feb 27 12:34:18 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:18 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a4ab9800-a375-410b-95b0-dd4b42985c70 tempest-VolumeDependencyTests-452734889 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5" returned: 0 in 0.527s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a4ab9800-a375-410b-95b0-dd4b42985c70 tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:18 devstack sudo[89339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5 Feb 27 12:34:18 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:19 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a4ab9800-a375-410b-95b0-dd4b42985c70 tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5" returned: 0 in 0.444s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a4ab9800-a375-410b-95b0-dd4b42985c70 tempest-VolumeDependencyTests-452734889 None] Lock "cinder-quobyte-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5" released by "delete_volume" :: held 0.998s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-a4ab9800-a375-410b-95b0-dd4b42985c70 tempest-VolumeDependencyTests-452734889 None] Created reservations ['76c5b280-402b-4d0a-9398-75ea037321b5', 'a671eb1d-08b1-43a0-bac0-843c21681f48', '4e10afad-9477-4125-bbaf-faf6832df9ee', 'f0a58d2a-59ad-4b4e-ab41-673f7a2c5c3f'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a4ab9800-a375-410b-95b0-dd4b42985c70 tempest-VolumeDependencyTests-452734889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a4ab9800-a375-410b-95b0-dd4b42985c70 tempest-VolumeDependencyTests-452734889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a4ab9800-a375-410b-95b0-dd4b42985c70 tempest-VolumeDependencyTests-452734889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a4ab9800-a375-410b-95b0-dd4b42985c70 tempest-VolumeDependencyTests-452734889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a4ab9800-a375-410b-95b0-dd4b42985c70 tempest-VolumeDependencyTests-452734889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a4ab9800-a375-410b-95b0-dd4b42985c70 tempest-VolumeDependencyTests-452734889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:19 devstack sudo[89342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:34:19 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Flow 'volume_create_manager' (0d68569f-eb2b-4275-bb17-0fa1d3982968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef80790-bbdc-4cda-a282-735ef1b1c678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef80790-bbdc-4cda-a282-735ef1b1c678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a626babd-2ee4-4c42-b869-7cde0cdbc52e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e59a47f69944b897d3130ce904a0c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:19Z,use_quota=True,user_id='9c1129f9801741baa089812f54a26838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (313e628a-5da8-4694-8859-f99347b38fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (313e628a-5da8-4694-8859-f99347b38fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107c2eb1-9d68-49f1-a224-ba67f4f60034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107c2eb1-9d68-49f1-a224-ba67f4f60034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a626babd-2ee4-4c42-b869-7cde0cdbc52e', 'volume_name': 'volume-a626babd-2ee4-4c42-b869-7cde0cdbc52e', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4282958-c18d-400f-8961-e422dd827224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4282958-c18d-400f-8961-e422dd827224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f1a432-3ea3-442e-9553-c895b9e278f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:19 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Volume a626babd-2ee4-4c42-b869-7cde0cdbc52e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a626babd-2ee4-4c42-b869-7cde0cdbc52e', 'volume_size': 1} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a626babd-2ee4-4c42-b869-7cde0cdbc52e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e59a47f69944b897d3130ce904a0c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:19Z,use_quota=True,user_id='9c1129f9801741baa089812f54a26838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Creating volume a626babd-2ee4-4c42-b869-7cde0cdbc52e {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:34:19 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a626babd-2ee4-4c42-b869-7cde0cdbc52e 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:19 devstack sudo[89344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a626babd-2ee4-4c42-b869-7cde0cdbc52e 1073741824 Feb 27 12:34:19 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:19 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a4ab9800-a375-410b-95b0-dd4b42985c70 tempest-VolumeDependencyTests-452734889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.460s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-a4ab9800-a375-410b-95b0-dd4b42985c70 tempest-VolumeDependencyTests-452734889 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:34:19 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-a4ab9800-a375-410b-95b0-dd4b42985c70 tempest-VolumeDependencyTests-452734889 None] Deleted volume successfully. Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a4ab9800-a375-410b-95b0-dd4b42985c70 tempest-VolumeDependencyTests-452734889 None] Lock "cinder-0d0add9e-04c7-4c99-a53f-a3c2a7c999e5-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:19 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a626babd-2ee4-4c42-b869-7cde0cdbc52e 1073741824" returned: 0 in 0.598s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a626babd-2ee4-4c42-b869-7cde0cdbc52e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:20 devstack sudo[89351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a626babd-2ee4-4c42-b869-7cde0cdbc52e Feb 27 12:34:20 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:20 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a626babd-2ee4-4c42-b869-7cde0cdbc52e" returned: 0 in 0.447s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f1a432-3ea3-442e-9553-c895b9e278f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a626babd-2ee4-4c42-b869-7cde0cdbc52e', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc52071-2b1d-4c74-9833-2a98a9694b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:20 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Volume volume-a626babd-2ee4-4c42-b869-7cde0cdbc52e (a626babd-2ee4-4c42-b869-7cde0cdbc52e): created successfully Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc52071-2b1d-4c74-9833-2a98a9694b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Flow 'volume_create_manager' (0d68569f-eb2b-4275-bb17-0fa1d3982968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:20 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-21bcfcd3-b92d-45a5-9f6b-9161de785c12 tempest-VolumesListAdminTestJSON-204194311 None] Created volume successfully. Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Flow 'volume_create_manager' (088bc3ac-4866-4de3-9558-eec71b3e2a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58229103-3474-4e9a-84f2-c86757531f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58229103-3474-4e9a-84f2-c86757531f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2111175548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b875c34-30b2-4b7a-9fac-5d61df0c2122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9456e625f5a644cc9a3a8a9c5384d351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:21Z,use_quota=True,user_id='d84aa1d05ac74bf9ad9d6e5a9aee570c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18d1c7fc-8687-4727-b86f-c8eb162c4d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18d1c7fc-8687-4727-b86f-c8eb162c4d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5fc483-38a6-4374-a8df-7eb335be5cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5fc483-38a6-4374-a8df-7eb335be5cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b875c34-30b2-4b7a-9fac-5d61df0c2122', 'volume_name': 'volume-4b875c34-30b2-4b7a-9fac-5d61df0c2122', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35767bff-672a-44ab-ac06-67e4a881eb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35767bff-672a-44ab-ac06-67e4a881eb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0100bd4c-8777-4695-892c-f1f50104e5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:20 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Volume 4b875c34-30b2-4b7a-9fac-5d61df0c2122: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b875c34-30b2-4b7a-9fac-5d61df0c2122', 'volume_size': 1} Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2111175548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b875c34-30b2-4b7a-9fac-5d61df0c2122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9456e625f5a644cc9a3a8a9c5384d351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:21Z,use_quota=True,user_id='d84aa1d05ac74bf9ad9d6e5a9aee570c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Creating volume 4b875c34-30b2-4b7a-9fac-5d61df0c2122 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:34:20 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:34:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4b875c34-30b2-4b7a-9fac-5d61df0c2122 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:20 devstack sudo[89355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4b875c34-30b2-4b7a-9fac-5d61df0c2122 1073741824 Feb 27 12:34:20 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:21 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1547e330-1b43-4ea8-97f6-3ac172641b08 tempest-VolumesListAdminTestJSON-204194311 None] Acquiring lock "cinder-a626babd-2ee4-4c42-b869-7cde0cdbc52e-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:21 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1547e330-1b43-4ea8-97f6-3ac172641b08 tempest-VolumesListAdminTestJSON-204194311 None] Lock "cinder-a626babd-2ee4-4c42-b869-7cde0cdbc52e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:21 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1547e330-1b43-4ea8-97f6-3ac172641b08 tempest-VolumesListAdminTestJSON-204194311 None] Acquiring lock "cinder-quobyte-a626babd-2ee4-4c42-b869-7cde0cdbc52e" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:21 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1547e330-1b43-4ea8-97f6-3ac172641b08 tempest-VolumesListAdminTestJSON-204194311 None] Lock "cinder-quobyte-a626babd-2ee4-4c42-b869-7cde0cdbc52e" acquired by "delete_volume" :: waited 0.015s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:21 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4b875c34-30b2-4b7a-9fac-5d61df0c2122 1073741824" returned: 0 in 0.616s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:21 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6cc39f-86d6-48f0-81fb-3a0e03e82fcb]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1547e330-1b43-4ea8-97f6-3ac172641b08 tempest-VolumesListAdminTestJSON-204194311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a626babd-2ee4-4c42-b869-7cde0cdbc52e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:21 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1bd1354e-586c-4803-9f72-6e4cdf687c16 tempest-VolumesListAdminTestJSON-754476091 None] Acquiring lock "cinder-199e0106-3962-41fa-9cba-43990f42f3ef-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:21 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1bd1354e-586c-4803-9f72-6e4cdf687c16 tempest-VolumesListAdminTestJSON-754476091 None] Lock "cinder-199e0106-3962-41fa-9cba-43990f42f3ef-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4b875c34-30b2-4b7a-9fac-5d61df0c2122 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:21 devstack sudo[89361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4b875c34-30b2-4b7a-9fac-5d61df0c2122 Feb 27 12:34:21 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:21 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1bd1354e-586c-4803-9f72-6e4cdf687c16 tempest-VolumesListAdminTestJSON-754476091 None] Acquiring lock "cinder-quobyte-199e0106-3962-41fa-9cba-43990f42f3ef" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:21 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1bd1354e-586c-4803-9f72-6e4cdf687c16 tempest-VolumesListAdminTestJSON-754476091 None] Lock "cinder-quobyte-199e0106-3962-41fa-9cba-43990f42f3ef" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:21 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a626babd-2ee4-4c42-b869-7cde0cdbc52e Feb 27 12:34:21 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:21 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[902339c4-d8fd-47d4-a1b9-ed292faefc98]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1bd1354e-586c-4803-9f72-6e4cdf687c16 tempest-VolumesListAdminTestJSON-754476091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-199e0106-3962-41fa-9cba-43990f42f3ef {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:21 devstack sudo[89364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-199e0106-3962-41fa-9cba-43990f42f3ef Feb 27 12:34:21 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:22 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:34:22 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:22 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Flow 'volume_create_manager' (31738e35-6bb6-4155-a29f-2f78efe0c2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c58613c-2633-4da7-b8a3-b31fad175af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4b875c34-30b2-4b7a-9fac-5d61df0c2122" returned: 0 in 0.620s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1547e330-1b43-4ea8-97f6-3ac172641b08 tempest-VolumesListAdminTestJSON-204194311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a626babd-2ee4-4c42-b869-7cde0cdbc52e" returned: 0 in 0.664s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1bd1354e-586c-4803-9f72-6e4cdf687c16 tempest-VolumesListAdminTestJSON-754476091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-199e0106-3962-41fa-9cba-43990f42f3ef" returned: 0 in 0.555s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1547e330-1b43-4ea8-97f6-3ac172641b08 tempest-VolumesListAdminTestJSON-204194311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a626babd-2ee4-4c42-b869-7cde0cdbc52e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1bd1354e-586c-4803-9f72-6e4cdf687c16 tempest-VolumesListAdminTestJSON-754476091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-199e0106-3962-41fa-9cba-43990f42f3ef {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:22 devstack sudo[89373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a626babd-2ee4-4c42-b869-7cde0cdbc52e Feb 27 12:34:22 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c58613c-2633-4da7-b8a3-b31fad175af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2270c476-9d13-4c03-9fe2-9736535085db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55743bbc7ead49b483b132c70a6d4354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:22Z,use_quota=True,user_id='39a3d91ea60240adaaa851718b62b39b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:22 devstack sudo[89374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-199e0106-3962-41fa-9cba-43990f42f3ef Feb 27 12:34:22 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deae50dd-59cf-427c-8489-5c85b1d8c2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deae50dd-59cf-427c-8489-5c85b1d8c2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813dbb98-8311-4ed9-a41f-096e243c3bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813dbb98-8311-4ed9-a41f-096e243c3bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2270c476-9d13-4c03-9fe2-9736535085db', 'volume_name': 'volume-2270c476-9d13-4c03-9fe2-9736535085db', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b426734-676c-4f64-b217-54b3ebd01fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b426734-676c-4f64-b217-54b3ebd01fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df351199-dcd0-4176-8878-30237f85c9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:22 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Volume 2270c476-9d13-4c03-9fe2-9736535085db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2270c476-9d13-4c03-9fe2-9736535085db', 'volume_size': 1} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2270c476-9d13-4c03-9fe2-9736535085db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55743bbc7ead49b483b132c70a6d4354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:22Z,use_quota=True,user_id='39a3d91ea60240adaaa851718b62b39b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Creating volume 2270c476-9d13-4c03-9fe2-9736535085db {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:34:22 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2270c476-9d13-4c03-9fe2-9736535085db 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0100bd4c-8777-4695-892c-f1f50104e5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b875c34-30b2-4b7a-9fac-5d61df0c2122', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87023f9e-8933-48d1-9d76-efbd184ca350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:22 devstack sudo[89377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2270c476-9d13-4c03-9fe2-9736535085db 1073741824 Feb 27 12:34:22 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:22 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Volume volume-4b875c34-30b2-4b7a-9fac-5d61df0c2122 (4b875c34-30b2-4b7a-9fac-5d61df0c2122): created successfully Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87023f9e-8933-48d1-9d76-efbd184ca350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Flow 'volume_create_manager' (088bc3ac-4866-4de3-9558-eec71b3e2a41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:22 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-9b3a3583-77c9-45ce-88c4-a4c41363166d tempest-VolumesTransfersV357Test-1539157138 None] Created volume successfully. Feb 27 12:34:22 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1bd1354e-586c-4803-9f72-6e4cdf687c16 tempest-VolumesListAdminTestJSON-754476091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-199e0106-3962-41fa-9cba-43990f42f3ef" returned: 0 in 0.379s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1bd1354e-586c-4803-9f72-6e4cdf687c16 tempest-VolumesListAdminTestJSON-754476091 None] Lock "cinder-quobyte-199e0106-3962-41fa-9cba-43990f42f3ef" released by "delete_volume" :: held 0.966s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-1bd1354e-586c-4803-9f72-6e4cdf687c16 tempest-VolumesListAdminTestJSON-754476091 None] Created reservations ['80e166ff-6693-4d69-8e51-73480b5a3c47', '10b7f6a7-f903-4d57-8bab-40b86e5c3634', '46dc15fe-c337-405f-98d4-cc33cc51f685', '7bcfa017-d7f6-4519-9e19-d954717d6f7c'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:22 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1547e330-1b43-4ea8-97f6-3ac172641b08 tempest-VolumesListAdminTestJSON-204194311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a626babd-2ee4-4c42-b869-7cde0cdbc52e" returned: 0 in 0.453s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1547e330-1b43-4ea8-97f6-3ac172641b08 tempest-VolumesListAdminTestJSON-204194311 None] Lock "cinder-quobyte-a626babd-2ee4-4c42-b869-7cde0cdbc52e" released by "delete_volume" :: held 1.162s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1bd1354e-586c-4803-9f72-6e4cdf687c16 tempest-VolumesListAdminTestJSON-754476091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1bd1354e-586c-4803-9f72-6e4cdf687c16 tempest-VolumesListAdminTestJSON-754476091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-1bd1354e-586c-4803-9f72-6e4cdf687c16 tempest-VolumesListAdminTestJSON-754476091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-1bd1354e-586c-4803-9f72-6e4cdf687c16 tempest-VolumesListAdminTestJSON-754476091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1bd1354e-586c-4803-9f72-6e4cdf687c16 tempest-VolumesListAdminTestJSON-754476091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1bd1354e-586c-4803-9f72-6e4cdf687c16 tempest-VolumesListAdminTestJSON-754476091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:22 devstack sudo[89384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:34:22 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-1547e330-1b43-4ea8-97f6-3ac172641b08 tempest-VolumesListAdminTestJSON-204194311 None] Created reservations ['d7305a5d-3e2e-4668-80c8-0caa5e0e643b', 'dd730947-32a0-4d6f-a7c0-9025390e3def', '716f1f22-af36-4192-86ed-b275298693b0', '0f502895-0498-4cbf-a19e-5a962744e2de'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-83e697bd-a845-4478-b96b-c40fb9515833 tempest-VolumesListAdminTestJSON-754476091 None] Acquiring lock "cinder-14e65377-3c95-4106-b18d-c505ee091e40-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-83e697bd-a845-4478-b96b-c40fb9515833 tempest-VolumesListAdminTestJSON-754476091 None] Lock "cinder-14e65377-3c95-4106-b18d-c505ee091e40-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1547e330-1b43-4ea8-97f6-3ac172641b08 tempest-VolumesListAdminTestJSON-204194311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1547e330-1b43-4ea8-97f6-3ac172641b08 tempest-VolumesListAdminTestJSON-204194311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-1547e330-1b43-4ea8-97f6-3ac172641b08 tempest-VolumesListAdminTestJSON-204194311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-1547e330-1b43-4ea8-97f6-3ac172641b08 tempest-VolumesListAdminTestJSON-204194311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1547e330-1b43-4ea8-97f6-3ac172641b08 tempest-VolumesListAdminTestJSON-204194311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1547e330-1b43-4ea8-97f6-3ac172641b08 tempest-VolumesListAdminTestJSON-204194311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:22 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2270c476-9d13-4c03-9fe2-9736535085db 1073741824" returned: 0 in 0.564s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:22 devstack sudo[89386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:34:22 devstack sudo[89386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-83e697bd-a845-4478-b96b-c40fb9515833 tempest-VolumesListAdminTestJSON-754476091 None] Acquiring lock "cinder-quobyte-14e65377-3c95-4106-b18d-c505ee091e40" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-83e697bd-a845-4478-b96b-c40fb9515833 tempest-VolumesListAdminTestJSON-754476091 None] Lock "cinder-quobyte-14e65377-3c95-4106-b18d-c505ee091e40" acquired by "delete_volume" :: waited 0.014s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[2772f502-1833-43ca-a6ae-728333e33545]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-83e697bd-a845-4478-b96b-c40fb9515833 tempest-VolumesListAdminTestJSON-754476091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-14e65377-3c95-4106-b18d-c505ee091e40 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2270c476-9d13-4c03-9fe2-9736535085db {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:22 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2270c476-9d13-4c03-9fe2-9736535085db Feb 27 12:34:22 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:23 devstack sudo[89388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-14e65377-3c95-4106-b18d-c505ee091e40 Feb 27 12:34:23 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:23 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1bd1354e-586c-4803-9f72-6e4cdf687c16 tempest-VolumesListAdminTestJSON-754476091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.479s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:23 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-1bd1354e-586c-4803-9f72-6e4cdf687c16 tempest-VolumesListAdminTestJSON-754476091 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:34:23 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-1bd1354e-586c-4803-9f72-6e4cdf687c16 tempest-VolumesListAdminTestJSON-754476091 None] Deleted volume successfully. Feb 27 12:34:23 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1bd1354e-586c-4803-9f72-6e4cdf687c16 tempest-VolumesListAdminTestJSON-754476091 None] Lock "cinder-199e0106-3962-41fa-9cba-43990f42f3ef-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:23 devstack sudo[89386]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1547e330-1b43-4ea8-97f6-3ac172641b08 tempest-VolumesListAdminTestJSON-204194311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.589s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:23 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-1547e330-1b43-4ea8-97f6-3ac172641b08 tempest-VolumesListAdminTestJSON-204194311 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:34:23 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-1547e330-1b43-4ea8-97f6-3ac172641b08 tempest-VolumesListAdminTestJSON-204194311 None] Deleted volume successfully. Feb 27 12:34:23 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1547e330-1b43-4ea8-97f6-3ac172641b08 tempest-VolumesListAdminTestJSON-204194311 None] Lock "cinder-a626babd-2ee4-4c42-b869-7cde0cdbc52e-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:23 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2270c476-9d13-4c03-9fe2-9736535085db" returned: 0 in 0.553s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:23 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:34:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:23 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df351199-dcd0-4176-8878-30237f85c9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2270c476-9d13-4c03-9fe2-9736535085db', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:23 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eeb8ce2-516a-40ce-a946-ade2ac3dd8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:23 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Volume volume-2270c476-9d13-4c03-9fe2-9736535085db (2270c476-9d13-4c03-9fe2-9736535085db): created successfully Feb 27 12:34:23 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:23 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eeb8ce2-516a-40ce-a946-ade2ac3dd8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:23 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Flow 'volume_create_manager' (31738e35-6bb6-4155-a29f-2f78efe0c2a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:23 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-b74c649d-198a-451d-9167-4f4158ffb364 tempest-CinderUnicodeTest-1627730405 None] Created volume successfully. Feb 27 12:34:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-83e697bd-a845-4478-b96b-c40fb9515833 tempest-VolumesListAdminTestJSON-754476091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-14e65377-3c95-4106-b18d-c505ee091e40" returned: 0 in 0.621s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-83e697bd-a845-4478-b96b-c40fb9515833 tempest-VolumesListAdminTestJSON-754476091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-14e65377-3c95-4106-b18d-c505ee091e40 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:23 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-1b86f0d3-3c01-441b-b4ea-bf331dba3a88 tempest-VolumesTransfersV357Test-1012908692 None] Transfer volume completed successfully. Feb 27 12:34:23 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-14e65377-3c95-4106-b18d-c505ee091e40 Feb 27 12:34:23 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:23 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-83e697bd-a845-4478-b96b-c40fb9515833 tempest-VolumesListAdminTestJSON-754476091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-14e65377-3c95-4106-b18d-c505ee091e40" returned: 0 in 0.399s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:23 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-83e697bd-a845-4478-b96b-c40fb9515833 tempest-VolumesListAdminTestJSON-754476091 None] Lock "cinder-quobyte-14e65377-3c95-4106-b18d-c505ee091e40" released by "delete_volume" :: held 1.053s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:23 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-83e697bd-a845-4478-b96b-c40fb9515833 tempest-VolumesListAdminTestJSON-754476091 None] Created reservations ['17f1e59d-a3fb-48eb-8351-42edbaa902a9', 'ca7e6c4a-2994-4a11-994a-9917b2628000', '005b7efb-1e3f-4a3b-ac89-1c62c647d8c0', 'c7e54981-c8f8-435a-87e3-ce4368227240'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-83e697bd-a845-4478-b96b-c40fb9515833 tempest-VolumesListAdminTestJSON-754476091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-83e697bd-a845-4478-b96b-c40fb9515833 tempest-VolumesListAdminTestJSON-754476091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-83e697bd-a845-4478-b96b-c40fb9515833 tempest-VolumesListAdminTestJSON-754476091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-83e697bd-a845-4478-b96b-c40fb9515833 tempest-VolumesListAdminTestJSON-754476091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-83e697bd-a845-4478-b96b-c40fb9515833 tempest-VolumesListAdminTestJSON-754476091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-83e697bd-a845-4478-b96b-c40fb9515833 tempest-VolumesListAdminTestJSON-754476091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:24 devstack sudo[89401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:34:24 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5df67aa0-56c3-4cf7-b8d7-c2c4333cebac tempest-VolumesTransfersV357Test-1771572068 None] Acquiring lock "cinder-4b875c34-30b2-4b7a-9fac-5d61df0c2122-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5df67aa0-56c3-4cf7-b8d7-c2c4333cebac tempest-VolumesTransfersV357Test-1771572068 None] Lock "cinder-4b875c34-30b2-4b7a-9fac-5d61df0c2122-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5df67aa0-56c3-4cf7-b8d7-c2c4333cebac tempest-VolumesTransfersV357Test-1771572068 None] Acquiring lock "cinder-quobyte-4b875c34-30b2-4b7a-9fac-5d61df0c2122" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:24 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-83e697bd-a845-4478-b96b-c40fb9515833 tempest-VolumesListAdminTestJSON-754476091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.408s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-83e697bd-a845-4478-b96b-c40fb9515833 tempest-VolumesListAdminTestJSON-754476091 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:34:24 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-83e697bd-a845-4478-b96b-c40fb9515833 tempest-VolumesListAdminTestJSON-754476091 None] Deleted volume successfully. Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5df67aa0-56c3-4cf7-b8d7-c2c4333cebac tempest-VolumesTransfersV357Test-1771572068 None] Lock "cinder-quobyte-4b875c34-30b2-4b7a-9fac-5d61df0c2122" acquired by "delete_volume" :: waited 0.019s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27d5fd0-4100-48e1-a1d9-f0fa7681220f]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5df67aa0-56c3-4cf7-b8d7-c2c4333cebac tempest-VolumesTransfersV357Test-1771572068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4b875c34-30b2-4b7a-9fac-5d61df0c2122 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-83e697bd-a845-4478-b96b-c40fb9515833 tempest-VolumesListAdminTestJSON-754476091 None] Lock "cinder-14e65377-3c95-4106-b18d-c505ee091e40-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:24 devstack sudo[89404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4b875c34-30b2-4b7a-9fac-5d61df0c2122 Feb 27 12:34:24 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Flow 'volume_create_manager' (781c1f1d-210e-47ba-ace2-ec72ef165c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae73e8e5-af5d-4531-aca0-608ad9e1261d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae73e8e5-af5d-4531-aca0-608ad9e1261d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2072662291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42ccb862-3009-4bb7-8e9b-fec8daae559a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55743bbc7ead49b483b132c70a6d4354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:25Z,use_quota=True,user_id='39a3d91ea60240adaaa851718b62b39b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4ab184-d049-467c-8d96-ddcf693162e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4ab184-d049-467c-8d96-ddcf693162e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5528773e-7a9f-4341-b3eb-e0841d4fc839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5528773e-7a9f-4341-b3eb-e0841d4fc839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42ccb862-3009-4bb7-8e9b-fec8daae559a', 'volume_name': 'volume-42ccb862-3009-4bb7-8e9b-fec8daae559a', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (675be42b-d0f7-48bb-bcf8-9018ec8d6b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (675be42b-d0f7-48bb-bcf8-9018ec8d6b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2ebc94-ab09-4e7a-af7f-afcc11fb2dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:24 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Volume 42ccb862-3009-4bb7-8e9b-fec8daae559a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42ccb862-3009-4bb7-8e9b-fec8daae559a', 'volume_size': 1} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2072662291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42ccb862-3009-4bb7-8e9b-fec8daae559a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55743bbc7ead49b483b132c70a6d4354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:25Z,use_quota=True,user_id='39a3d91ea60240adaaa851718b62b39b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Creating volume 42ccb862-3009-4bb7-8e9b-fec8daae559a {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:34:24 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:34:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:24 devstack sudo[89406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a 1073741824 Feb 27 12:34:24 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:25 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5df67aa0-56c3-4cf7-b8d7-c2c4333cebac tempest-VolumesTransfersV357Test-1771572068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4b875c34-30b2-4b7a-9fac-5d61df0c2122" returned: 0 in 0.554s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5df67aa0-56c3-4cf7-b8d7-c2c4333cebac tempest-VolumesTransfersV357Test-1771572068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4b875c34-30b2-4b7a-9fac-5d61df0c2122 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:25 devstack sudo[89411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4b875c34-30b2-4b7a-9fac-5d61df0c2122 Feb 27 12:34:25 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6f794bc8-b9c3-4ae3-9477-7062f43b1022 tempest-VolumesListAdminTestJSON-754476091 None] Acquiring lock "cinder-53a05df7-a2c9-4b8d-90a7-86059615c030-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6f794bc8-b9c3-4ae3-9477-7062f43b1022 tempest-VolumesListAdminTestJSON-754476091 None] Lock "cinder-53a05df7-a2c9-4b8d-90a7-86059615c030-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6f794bc8-b9c3-4ae3-9477-7062f43b1022 tempest-VolumesListAdminTestJSON-754476091 None] Acquiring lock "cinder-quobyte-53a05df7-a2c9-4b8d-90a7-86059615c030" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6f794bc8-b9c3-4ae3-9477-7062f43b1022 tempest-VolumesListAdminTestJSON-754476091 None] Lock "cinder-quobyte-53a05df7-a2c9-4b8d-90a7-86059615c030" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d514e006-cff2-46b0-bb15-a3d031757141]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6f794bc8-b9c3-4ae3-9477-7062f43b1022 tempest-VolumesListAdminTestJSON-754476091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-53a05df7-a2c9-4b8d-90a7-86059615c030 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:25 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-53a05df7-a2c9-4b8d-90a7-86059615c030 Feb 27 12:34:25 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:25 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a 1073741824" returned: 0 in 0.545s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:25 devstack sudo[89418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a Feb 27 12:34:25 devstack sudo[89418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:25 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5df67aa0-56c3-4cf7-b8d7-c2c4333cebac tempest-VolumesTransfersV357Test-1771572068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-4b875c34-30b2-4b7a-9fac-5d61df0c2122" returned: 0 in 0.445s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5df67aa0-56c3-4cf7-b8d7-c2c4333cebac tempest-VolumesTransfersV357Test-1771572068 None] Lock "cinder-quobyte-4b875c34-30b2-4b7a-9fac-5d61df0c2122" released by "delete_volume" :: held 1.033s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-5df67aa0-56c3-4cf7-b8d7-c2c4333cebac tempest-VolumesTransfersV357Test-1771572068 None] Created reservations ['4786c637-36b2-4055-b4b6-c1f696a9f3d5', '11231471-82a1-4a99-bf63-a03683d5653c', 'f0e7f107-d8cf-4c82-ac3f-754a6fea02b8', '5796d9e5-c926-49ac-9c0f-24d5c102d18b'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-5df67aa0-56c3-4cf7-b8d7-c2c4333cebac tempest-VolumesTransfersV357Test-1771572068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-5df67aa0-56c3-4cf7-b8d7-c2c4333cebac tempest-VolumesTransfersV357Test-1771572068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-5df67aa0-56c3-4cf7-b8d7-c2c4333cebac tempest-VolumesTransfersV357Test-1771572068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-5df67aa0-56c3-4cf7-b8d7-c2c4333cebac tempest-VolumesTransfersV357Test-1771572068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-5df67aa0-56c3-4cf7-b8d7-c2c4333cebac tempest-VolumesTransfersV357Test-1771572068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5df67aa0-56c3-4cf7-b8d7-c2c4333cebac tempest-VolumesTransfersV357Test-1771572068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:25 devstack sudo[89424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:34:25 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:25 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6f794bc8-b9c3-4ae3-9477-7062f43b1022 tempest-VolumesListAdminTestJSON-754476091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-53a05df7-a2c9-4b8d-90a7-86059615c030" returned: 0 in 0.521s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6f794bc8-b9c3-4ae3-9477-7062f43b1022 tempest-VolumesListAdminTestJSON-754476091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-53a05df7-a2c9-4b8d-90a7-86059615c030 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:25 devstack sudo[89427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-53a05df7-a2c9-4b8d-90a7-86059615c030 Feb 27 12:34:25 devstack sudo[89427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:25 devstack sudo[89418]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a" returned: 0 in 0.442s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2ebc94-ab09-4e7a-af7f-afcc11fb2dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42ccb862-3009-4bb7-8e9b-fec8daae559a', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac4efb8-5325-4edb-b2fa-749998cdbcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:25 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Volume volume-42ccb862-3009-4bb7-8e9b-fec8daae559a (42ccb862-3009-4bb7-8e9b-fec8daae559a): created successfully Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac4efb8-5325-4edb-b2fa-749998cdbcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:25 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Flow 'volume_create_manager' (781c1f1d-210e-47ba-ace2-ec72ef165c9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:25 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-90bf05b0-f575-4c53-9bbf-904f7e696341 tempest-CinderUnicodeTest-1627730405 None] Created volume successfully. Feb 27 12:34:26 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5df67aa0-56c3-4cf7-b8d7-c2c4333cebac tempest-VolumesTransfersV357Test-1771572068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.423s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-5df67aa0-56c3-4cf7-b8d7-c2c4333cebac tempest-VolumesTransfersV357Test-1771572068 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:34:26 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-5df67aa0-56c3-4cf7-b8d7-c2c4333cebac tempest-VolumesTransfersV357Test-1771572068 None] Deleted volume successfully. Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5df67aa0-56c3-4cf7-b8d7-c2c4333cebac tempest-VolumesTransfersV357Test-1771572068 None] Lock "cinder-4b875c34-30b2-4b7a-9fac-5d61df0c2122-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:26 devstack sudo[89427]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6f794bc8-b9c3-4ae3-9477-7062f43b1022 tempest-VolumesListAdminTestJSON-754476091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-53a05df7-a2c9-4b8d-90a7-86059615c030" returned: 0 in 0.395s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6f794bc8-b9c3-4ae3-9477-7062f43b1022 tempest-VolumesListAdminTestJSON-754476091 None] Lock "cinder-quobyte-53a05df7-a2c9-4b8d-90a7-86059615c030" released by "delete_volume" :: held 0.941s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-6f794bc8-b9c3-4ae3-9477-7062f43b1022 tempest-VolumesListAdminTestJSON-754476091 None] Created reservations ['9969ae92-2934-4fd0-adff-4e6a73caf922', '5efad1fe-947a-4ec8-abac-9bcb73187759', 'ee58fccd-2e80-43d1-982d-f0a4a05b4045', '56e3744a-30cb-4e24-a4bf-f760b50555e8'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6f794bc8-b9c3-4ae3-9477-7062f43b1022 tempest-VolumesListAdminTestJSON-754476091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6f794bc8-b9c3-4ae3-9477-7062f43b1022 tempest-VolumesListAdminTestJSON-754476091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6f794bc8-b9c3-4ae3-9477-7062f43b1022 tempest-VolumesListAdminTestJSON-754476091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6f794bc8-b9c3-4ae3-9477-7062f43b1022 tempest-VolumesListAdminTestJSON-754476091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6f794bc8-b9c3-4ae3-9477-7062f43b1022 tempest-VolumesListAdminTestJSON-754476091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6f794bc8-b9c3-4ae3-9477-7062f43b1022 tempest-VolumesListAdminTestJSON-754476091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:26 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:34:26 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:26 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6f794bc8-b9c3-4ae3-9477-7062f43b1022 tempest-VolumesListAdminTestJSON-754476091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.449s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-6f794bc8-b9c3-4ae3-9477-7062f43b1022 tempest-VolumesListAdminTestJSON-754476091 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:34:26 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-6f794bc8-b9c3-4ae3-9477-7062f43b1022 tempest-VolumesListAdminTestJSON-754476091 None] Deleted volume successfully. Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6f794bc8-b9c3-4ae3-9477-7062f43b1022 tempest-VolumesListAdminTestJSON-754476091 None] Lock "cinder-53a05df7-a2c9-4b8d-90a7-86059615c030-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Flow 'volume_create_manager' (6eceb318-91e7-4a82-893c-b4e0c63e8ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd3b1199-1849-4fb2-a41f-3a282c4d588f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd3b1199-1849-4fb2-a41f-3a282c4d588f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1031929299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9456e625f5a644cc9a3a8a9c5384d351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:27Z,use_quota=True,user_id='d84aa1d05ac74bf9ad9d6e5a9aee570c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9505c4d8-4d3f-40d6-b081-57117bbe28d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9505c4d8-4d3f-40d6-b081-57117bbe28d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d3663e-d2c7-4c24-aca1-38aae0e5d7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d3663e-d2c7-4c24-aca1-38aae0e5d7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7', 'volume_name': 'volume-49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86dec998-388e-4e15-9010-536515d94e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86dec998-388e-4e15-9010-536515d94e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0743090b-9848-42a9-8645-bdd31155cc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:26 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Volume 49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7', 'volume_size': 1} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1031929299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9456e625f5a644cc9a3a8a9c5384d351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:27Z,use_quota=True,user_id='d84aa1d05ac74bf9ad9d6e5a9aee570c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Creating volume 49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:34:26 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:34:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:26 devstack sudo[89440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7 1073741824 Feb 27 12:34:26 devstack sudo[89440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2eaa9df8-9c08-4fee-91d6-885817bbbc02 tempest-CinderUnicodeTest-1627730405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:27 devstack sudo[89440]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7 1073741824" returned: 0 in 0.632s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:27 devstack sudo[89477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7 Feb 27 12:34:27 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:28 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7" returned: 0 in 0.424s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:28 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:34:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2eaa9df8-9c08-4fee-91d6-885817bbbc02 tempest-CinderUnicodeTest-1627730405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.055s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:28 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0743090b-9848-42a9-8645-bdd31155cc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:28 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b3d0b8-2fc1-4984-95e7-2c9020a6ba40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:28 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-2eaa9df8-9c08-4fee-91d6-885817bbbc02 tempest-CinderUnicodeTest-1627730405 None] Creating offline snapshot 89bd35a7-dac2-4abb-b286-6fe4a5021015 of volume 42ccb862-3009-4bb7-8e9b-fec8daae559a {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:34:28 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Volume volume-49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7 (49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7): created successfully Feb 27 12:34:28 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b3d0b8-2fc1-4984-95e7-2c9020a6ba40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:28 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Flow 'volume_create_manager' (6eceb318-91e7-4a82-893c-b4e0c63e8ee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:28 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80b8d5f-56bf-46ab-9caa-4acb5055ff26]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2eaa9df8-9c08-4fee-91d6-885817bbbc02 tempest-CinderUnicodeTest-1627730405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:28 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-b128b9be-fbe9-476f-b308-f47ee568b763 tempest-VolumesTransfersV357Test-1539157138 None] Created volume successfully. Feb 27 12:34:28 devstack sudo[89482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a Feb 27 12:34:28 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:28 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2eaa9df8-9c08-4fee-91d6-885817bbbc02 tempest-CinderUnicodeTest-1627730405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a" returned: 0 in 0.518s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2eaa9df8-9c08-4fee-91d6-885817bbbc02 tempest-CinderUnicodeTest-1627730405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a.89bd35a7-dac2-4abb-b286-6fe4a5021015 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:28 devstack sudo[89487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a.89bd35a7-dac2-4abb-b286-6fe4a5021015 1G Feb 27 12:34:28 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:29 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2eaa9df8-9c08-4fee-91d6-885817bbbc02 tempest-CinderUnicodeTest-1627730405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a.89bd35a7-dac2-4abb-b286-6fe4a5021015 1G" returned: 0 in 0.553s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2eaa9df8-9c08-4fee-91d6-885817bbbc02 tempest-CinderUnicodeTest-1627730405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42ccb862-3009-4bb7-8e9b-fec8daae559a -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a.89bd35a7-dac2-4abb-b286-6fe4a5021015 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:29 devstack sudo[89492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42ccb862-3009-4bb7-8e9b-fec8daae559a -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a.89bd35a7-dac2-4abb-b286-6fe4a5021015 Feb 27 12:34:29 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:29 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-ebdd7e1d-3efc-4d7a-9dd1-d9d47883be3e tempest-VolumesTransfersV357Test-1771572068 None] Acquiring lock "cinder-49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:29 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-ebdd7e1d-3efc-4d7a-9dd1-d9d47883be3e tempest-VolumesTransfersV357Test-1771572068 None] Lock "cinder-49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:29 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-ebdd7e1d-3efc-4d7a-9dd1-d9d47883be3e tempest-VolumesTransfersV357Test-1771572068 None] Acquiring lock "cinder-quobyte-49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:29 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-ebdd7e1d-3efc-4d7a-9dd1-d9d47883be3e tempest-VolumesTransfersV357Test-1771572068 None] Lock "cinder-quobyte-49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7" acquired by "delete_volume" :: waited 0.007s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:29 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[08aef87a-0b10-4e58-b9da-b23f02dbe940]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ebdd7e1d-3efc-4d7a-9dd1-d9d47883be3e tempest-VolumesTransfersV357Test-1771572068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:29 devstack sudo[89494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7 Feb 27 12:34:29 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:29 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2eaa9df8-9c08-4fee-91d6-885817bbbc02 tempest-CinderUnicodeTest-1627730405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42ccb862-3009-4bb7-8e9b-fec8daae559a -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a.89bd35a7-dac2-4abb-b286-6fe4a5021015" returned: 0 in 0.531s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:29 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-2eaa9df8-9c08-4fee-91d6-885817bbbc02 tempest-CinderUnicodeTest-1627730405 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a.89bd35a7-dac2-4abb-b286-6fe4a5021015 is being set with open permissions: ugo+rw Feb 27 12:34:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2eaa9df8-9c08-4fee-91d6-885817bbbc02 tempest-CinderUnicodeTest-1627730405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a.89bd35a7-dac2-4abb-b286-6fe4a5021015 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:29 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a.89bd35a7-dac2-4abb-b286-6fe4a5021015 Feb 27 12:34:29 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:29 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ebdd7e1d-3efc-4d7a-9dd1-d9d47883be3e tempest-VolumesTransfersV357Test-1771572068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7" returned: 0 in 0.558s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ebdd7e1d-3efc-4d7a-9dd1-d9d47883be3e tempest-VolumesTransfersV357Test-1771572068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:29 devstack sudo[89504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7 Feb 27 12:34:29 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:30 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2eaa9df8-9c08-4fee-91d6-885817bbbc02 tempest-CinderUnicodeTest-1627730405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a.89bd35a7-dac2-4abb-b286-6fe4a5021015" returned: 0 in 0.442s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2eaa9df8-9c08-4fee-91d6-885817bbbc02 tempest-CinderUnicodeTest-1627730405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:30 devstack sudo[89507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a.info Feb 27 12:34:30 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:30 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ebdd7e1d-3efc-4d7a-9dd1-d9d47883be3e tempest-VolumesTransfersV357Test-1771572068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7" returned: 0 in 0.433s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:30 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-ebdd7e1d-3efc-4d7a-9dd1-d9d47883be3e tempest-VolumesTransfersV357Test-1771572068 None] Lock "cinder-quobyte-49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7" released by "delete_volume" :: held 1.015s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:30 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-ebdd7e1d-3efc-4d7a-9dd1-d9d47883be3e tempest-VolumesTransfersV357Test-1771572068 None] Created reservations ['09dba0b9-faf6-40ad-b08c-815777728ccb', '925011ab-3141-4d7e-a610-c6f0c61319a5', '30a16982-ac49-4eca-b0bb-a07482a2477d', '6714d542-815c-4def-a60f-faf52db21f12'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ebdd7e1d-3efc-4d7a-9dd1-d9d47883be3e tempest-VolumesTransfersV357Test-1771572068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ebdd7e1d-3efc-4d7a-9dd1-d9d47883be3e tempest-VolumesTransfersV357Test-1771572068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:30 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ebdd7e1d-3efc-4d7a-9dd1-d9d47883be3e tempest-VolumesTransfersV357Test-1771572068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:30 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-ebdd7e1d-3efc-4d7a-9dd1-d9d47883be3e tempest-VolumesTransfersV357Test-1771572068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ebdd7e1d-3efc-4d7a-9dd1-d9d47883be3e tempest-VolumesTransfersV357Test-1771572068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ebdd7e1d-3efc-4d7a-9dd1-d9d47883be3e tempest-VolumesTransfersV357Test-1771572068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:30 devstack sudo[89510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:34:30 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:30 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2eaa9df8-9c08-4fee-91d6-885817bbbc02 tempest-CinderUnicodeTest-1627730405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a.info" returned: 0 in 0.430s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:30 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-2eaa9df8-9c08-4fee-91d6-885817bbbc02 tempest-CinderUnicodeTest-1627730405 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a.info is being set with open permissions: ugo+rw Feb 27 12:34:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2eaa9df8-9c08-4fee-91d6-885817bbbc02 tempest-CinderUnicodeTest-1627730405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:30 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a.info Feb 27 12:34:30 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:30 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ebdd7e1d-3efc-4d7a-9dd1-d9d47883be3e tempest-VolumesTransfersV357Test-1771572068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.509s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:30 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-ebdd7e1d-3efc-4d7a-9dd1-d9d47883be3e tempest-VolumesTransfersV357Test-1771572068 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:34:30 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-ebdd7e1d-3efc-4d7a-9dd1-d9d47883be3e tempest-VolumesTransfersV357Test-1771572068 None] Deleted volume successfully. Feb 27 12:34:30 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-ebdd7e1d-3efc-4d7a-9dd1-d9d47883be3e tempest-VolumesTransfersV357Test-1771572068 None] Lock "cinder-49f8035e-1fb8-4e4f-ab7e-8a1897b19fa7-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:31 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2eaa9df8-9c08-4fee-91d6-885817bbbc02 tempest-CinderUnicodeTest-1627730405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a.info" returned: 0 in 0.422s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2eaa9df8-9c08-4fee-91d6-885817bbbc02 tempest-CinderUnicodeTest-1627730405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.970s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:31 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-2eaa9df8-9c08-4fee-91d6-885817bbbc02 tempest-CinderUnicodeTest-1627730405 None] Create snapshot completed successfully Feb 27 12:34:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a41acf44-1138-4683-983b-ba61981a769a tempest-CinderUnicodeTest-1627730405 None] Acquiring lock "cinder-89bd35a7-dac2-4abb-b286-6fe4a5021015-delete_snapshot" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a41acf44-1138-4683-983b-ba61981a769a tempest-CinderUnicodeTest-1627730405 None] Lock "cinder-89bd35a7-dac2-4abb-b286-6fe4a5021015-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a41acf44-1138-4683-983b-ba61981a769a tempest-CinderUnicodeTest-1627730405 None] Acquiring lock "cinder-quobyte-42ccb862-3009-4bb7-8e9b-fec8daae559a" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a41acf44-1138-4683-983b-ba61981a769a tempest-CinderUnicodeTest-1627730405 None] Lock "cinder-quobyte-42ccb862-3009-4bb7-8e9b-fec8daae559a" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a41acf44-1138-4683-983b-ba61981a769a tempest-CinderUnicodeTest-1627730405 None] Acquiring lock "cinder-quobyte-89bd35a7-dac2-4abb-b286-6fe4a5021015" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a41acf44-1138-4683-983b-ba61981a769a tempest-CinderUnicodeTest-1627730405 None] Lock "cinder-quobyte-89bd35a7-dac2-4abb-b286-6fe4a5021015" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:31 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-a41acf44-1138-4683-983b-ba61981a769a tempest-CinderUnicodeTest-1627730405 None] Deleting offline snapshot 89bd35a7-dac2-4abb-b286-6fe4a5021015 of volume 42ccb862-3009-4bb7-8e9b-fec8daae559a {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:34:31 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-a41acf44-1138-4683-983b-ba61981a769a tempest-CinderUnicodeTest-1627730405 None] snapshot_file for this snap is: volume-42ccb862-3009-4bb7-8e9b-fec8daae559a.89bd35a7-dac2-4abb-b286-6fe4a5021015 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:34:31 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[337b9d9a-9b0f-48dc-8dc0-d4600ab47ecc]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a41acf44-1138-4683-983b-ba61981a769a tempest-CinderUnicodeTest-1627730405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a.89bd35a7-dac2-4abb-b286-6fe4a5021015 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:31 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a.89bd35a7-dac2-4abb-b286-6fe4a5021015 Feb 27 12:34:31 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:31 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a41acf44-1138-4683-983b-ba61981a769a tempest-CinderUnicodeTest-1627730405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a.89bd35a7-dac2-4abb-b286-6fe4a5021015" returned: 0 in 0.529s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:31 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-a41acf44-1138-4683-983b-ba61981a769a tempest-CinderUnicodeTest-1627730405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42ccb862-3009-4bb7-8e9b-fec8daae559a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:34:31 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89afb8c-5bdb-4645-acc8-311afbce42a8]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a41acf44-1138-4683-983b-ba61981a769a tempest-CinderUnicodeTest-1627730405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:31 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a Feb 27 12:34:31 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:32 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a41acf44-1138-4683-983b-ba61981a769a tempest-CinderUnicodeTest-1627730405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a" returned: 0 in 0.570s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a41acf44-1138-4683-983b-ba61981a769a tempest-CinderUnicodeTest-1627730405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a.89bd35a7-dac2-4abb-b286-6fe4a5021015 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:32 devstack sudo[89528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a.89bd35a7-dac2-4abb-b286-6fe4a5021015 Feb 27 12:34:32 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:32 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a41acf44-1138-4683-983b-ba61981a769a tempest-CinderUnicodeTest-1627730405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a.89bd35a7-dac2-4abb-b286-6fe4a5021015" returned: 0 in 0.491s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a41acf44-1138-4683-983b-ba61981a769a tempest-CinderUnicodeTest-1627730405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a.89bd35a7-dac2-4abb-b286-6fe4a5021015 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:32 devstack sudo[89533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a.89bd35a7-dac2-4abb-b286-6fe4a5021015 Feb 27 12:34:32 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:33 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a41acf44-1138-4683-983b-ba61981a769a tempest-CinderUnicodeTest-1627730405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a.89bd35a7-dac2-4abb-b286-6fe4a5021015" returned: 0 in 0.478s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:33 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a41acf44-1138-4683-983b-ba61981a769a tempest-CinderUnicodeTest-1627730405 None] Lock "cinder-quobyte-89bd35a7-dac2-4abb-b286-6fe4a5021015" released by "_delete_snapshot" :: held 2.139s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:33 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a41acf44-1138-4683-983b-ba61981a769a tempest-CinderUnicodeTest-1627730405 None] Lock "cinder-quobyte-42ccb862-3009-4bb7-8e9b-fec8daae559a" released by "delete_snapshot" :: held 2.155s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:33 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-a41acf44-1138-4683-983b-ba61981a769a tempest-CinderUnicodeTest-1627730405 None] Created reservations ['50c99e3e-f94b-4dab-bfa2-6c2b9aac3012', '11e77cfc-8fd9-43e3-a2f1-82fe4ad9a5dc', '90ead4d7-e038-4314-a7f3-920bedd488af', '87f17b08-ed2b-409e-bc83-a7a3faad3b3e'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:33 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-a41acf44-1138-4683-983b-ba61981a769a tempest-CinderUnicodeTest-1627730405 None] Delete snapshot completed successfully. Feb 27 12:34:33 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-a41acf44-1138-4683-983b-ba61981a769a tempest-CinderUnicodeTest-1627730405 None] Lock "cinder-89bd35a7-dac2-4abb-b286-6fe4a5021015-delete_snapshot" released by "delete_snapshot" :: held 2.267s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:34 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-0f8fe19f-9129-4cd9-bbc9-d0dca2f4f547 tempest-CinderUnicodeTest-1627730405 None] Acquiring lock "cinder-42ccb862-3009-4bb7-8e9b-fec8daae559a-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:34 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-0f8fe19f-9129-4cd9-bbc9-d0dca2f4f547 tempest-CinderUnicodeTest-1627730405 None] Lock "cinder-42ccb862-3009-4bb7-8e9b-fec8daae559a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:34 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-0f8fe19f-9129-4cd9-bbc9-d0dca2f4f547 tempest-CinderUnicodeTest-1627730405 None] Acquiring lock "cinder-quobyte-42ccb862-3009-4bb7-8e9b-fec8daae559a" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:34 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-0f8fe19f-9129-4cd9-bbc9-d0dca2f4f547 tempest-CinderUnicodeTest-1627730405 None] Lock "cinder-quobyte-42ccb862-3009-4bb7-8e9b-fec8daae559a" acquired by "delete_volume" :: waited 0.019s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:34 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[63442e9b-f2cb-438d-9b32-1c9960ca96be]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0f8fe19f-9129-4cd9-bbc9-d0dca2f4f547 tempest-CinderUnicodeTest-1627730405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:34 devstack sudo[89536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a Feb 27 12:34:34 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:35 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0f8fe19f-9129-4cd9-bbc9-d0dca2f4f547 tempest-CinderUnicodeTest-1627730405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a" returned: 0 in 0.622s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0f8fe19f-9129-4cd9-bbc9-d0dca2f4f547 tempest-CinderUnicodeTest-1627730405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:35 devstack sudo[89541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a Feb 27 12:34:35 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:35 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0f8fe19f-9129-4cd9-bbc9-d0dca2f4f547 tempest-CinderUnicodeTest-1627730405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-42ccb862-3009-4bb7-8e9b-fec8daae559a" returned: 0 in 0.591s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:35 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-0f8fe19f-9129-4cd9-bbc9-d0dca2f4f547 tempest-CinderUnicodeTest-1627730405 None] Lock "cinder-quobyte-42ccb862-3009-4bb7-8e9b-fec8daae559a" released by "delete_volume" :: held 1.276s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:35 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-0f8fe19f-9129-4cd9-bbc9-d0dca2f4f547 tempest-CinderUnicodeTest-1627730405 None] Created reservations ['903871d8-ac9d-4ae8-a8e7-48ff18c93545', '5244cfcb-d0d1-4672-9b54-95d44794fdce', '254f4317-50c1-4195-a55c-d16bfb3e6bbd', 'bd3aa292-8118-4d25-98d4-0c58824c1810'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0f8fe19f-9129-4cd9-bbc9-d0dca2f4f547 tempest-CinderUnicodeTest-1627730405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0f8fe19f-9129-4cd9-bbc9-d0dca2f4f547 tempest-CinderUnicodeTest-1627730405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:35 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0f8fe19f-9129-4cd9-bbc9-d0dca2f4f547 tempest-CinderUnicodeTest-1627730405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:35 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0f8fe19f-9129-4cd9-bbc9-d0dca2f4f547 tempest-CinderUnicodeTest-1627730405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0f8fe19f-9129-4cd9-bbc9-d0dca2f4f547 tempest-CinderUnicodeTest-1627730405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0f8fe19f-9129-4cd9-bbc9-d0dca2f4f547 tempest-CinderUnicodeTest-1627730405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:35 devstack sudo[89544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:34:35 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:34:36 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Flow 'volume_create_manager' (33141bc6-a1bd-4ce9-bc83-2ba109ceb3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b1f463-0c96-4656-a5a5-9400b034a625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0f8fe19f-9129-4cd9-bbc9-d0dca2f4f547 tempest-CinderUnicodeTest-1627730405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.535s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-0f8fe19f-9129-4cd9-bbc9-d0dca2f4f547 tempest-CinderUnicodeTest-1627730405 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:34:36 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-0f8fe19f-9129-4cd9-bbc9-d0dca2f4f547 tempest-CinderUnicodeTest-1627730405 None] Deleted volume successfully. Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b1f463-0c96-4656-a5a5-9400b034a625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1196317943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=643444f7-efc6-47d5-ac82-a47d1ee160c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a247ba949c744d0098686dc92ea9afae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:36Z,use_quota=True,user_id='a2cd4bc90bfc410b8d08b2dcc8b2396a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b06b2b-8cde-46a5-baf5-d86a1ed69938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b06b2b-8cde-46a5-baf5-d86a1ed69938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d81a9c5-9cf7-474b-b06a-197b6b19cf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d81a9c5-9cf7-474b-b06a-197b6b19cf7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '643444f7-efc6-47d5-ac82-a47d1ee160c2', 'volume_name': 'volume-643444f7-efc6-47d5-ac82-a47d1ee160c2', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (420e601a-3043-469f-ae88-dcfab9447b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (420e601a-3043-469f-ae88-dcfab9447b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98826f98-b1a2-43f8-905a-88e8a5c5b162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:36 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Volume 643444f7-efc6-47d5-ac82-a47d1ee160c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-643444f7-efc6-47d5-ac82-a47d1ee160c2', 'volume_size': 1} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1196317943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=643444f7-efc6-47d5-ac82-a47d1ee160c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a247ba949c744d0098686dc92ea9afae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:36Z,use_quota=True,user_id='a2cd4bc90bfc410b8d08b2dcc8b2396a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Creating volume 643444f7-efc6-47d5-ac82-a47d1ee160c2 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:34:36 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-0f8fe19f-9129-4cd9-bbc9-d0dca2f4f547 tempest-CinderUnicodeTest-1627730405 None] Lock "cinder-42ccb862-3009-4bb7-8e9b-fec8daae559a-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:36 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 1073741824 Feb 27 12:34:36 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Flow 'volume_create_manager' (90cce1b6-f183-439b-baeb-44440a333a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1ce3ae0-25c7-455c-bba6-fe6c36e396ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1ce3ae0-25c7-455c-bba6-fe6c36e396ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-975532199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9439b762-84b1-4d64-81b7-e2be6c5f23a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e128bd6174e48b0b38cb2f4500798e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:36Z,use_quota=True,user_id='a2bfea9611784b948bb621696b1937c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a2e8983-c9be-4f05-adac-19d068fb5545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a2e8983-c9be-4f05-adac-19d068fb5545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0608daa5-0e9f-462f-9042-fb7b77a22bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.image.glance [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Creating Keystone auth plugin from conf {{(pid=83077) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0608daa5-0e9f-462f-9042-fb7b77a22bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9439b762-84b1-4d64-81b7-e2be6c5f23a7', 'volume_name': 'volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7', 'volume_size': 1, 'image_id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c0a1769-4e00-41fd-a047-783ef98efe34', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa6a7971cf2a477f87f22a9fc435f45d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'created_at': datetime.datetime(2026, 2, 27, 11, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 11, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c0a1769-4e00-41fd-a047-783ef98efe34/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad662895-d8b9-4ff0-8a5d-a509ba06c9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad662895-d8b9-4ff0-8a5d-a509ba06c9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0892c1f-f5b6-4219-add0-b68d9f97440c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:36 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Volume 9439b762-84b1-4d64-81b7-e2be6c5f23a7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7', 'volume_size': 1, 'image_id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c0a1769-4e00-41fd-a047-783ef98efe34', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa6a7971cf2a477f87f22a9fc435f45d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'created_at': datetime.datetime(2026, 2, 27, 11, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 11, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c0a1769-4e00-41fd-a047-783ef98efe34/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Trying to clone 9439b762-84b1-4d64-81b7-e2be6c5f23a7 from image 9c0a1769-4e00-41fd-a047-783ef98efe34 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9c0a1769-4e00-41fd-a047-783ef98efe34', 'metadata': {}}]). {{(pid=83077) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4ff3afdf-9fec-44c4-bf43-e9889ead20f7 tempest-CinderUnicodeTest-1627730405 None] Acquiring lock "cinder-2270c476-9d13-4c03-9fe2-9736535085db-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4ff3afdf-9fec-44c4-bf43-e9889ead20f7 tempest-CinderUnicodeTest-1627730405 None] Lock "cinder-2270c476-9d13-4c03-9fe2-9736535085db-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4ff3afdf-9fec-44c4-bf43-e9889ead20f7 tempest-CinderUnicodeTest-1627730405 None] Acquiring lock "cinder-quobyte-2270c476-9d13-4c03-9fe2-9736535085db" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4ff3afdf-9fec-44c4-bf43-e9889ead20f7 tempest-CinderUnicodeTest-1627730405 None] Lock "cinder-quobyte-2270c476-9d13-4c03-9fe2-9736535085db" acquired by "delete_volume" :: waited 0.019s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[76449eaf-1df2-44b4-a80e-edf6fc8ae033]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4ff3afdf-9fec-44c4-bf43-e9889ead20f7 tempest-CinderUnicodeTest-1627730405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2270c476-9d13-4c03-9fe2-9736535085db {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:36 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2270c476-9d13-4c03-9fe2-9736535085db Feb 27 12:34:36 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_k6q69tpedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83077) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 12:34:36 devstack cinder-volume[83077]: INFO cinder.image.image_utils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Image download 20.69 MB at 20.69 MB/s Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d275356-4224-4950-b190-a19fa5a9c174]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_k6q69tpedevstack@QuobyteHD {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:36 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 1073741824" returned: 0 in 0.601s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:36 devstack sudo[89555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_k6q69tpedevstack@QuobyteHD Feb 27 12:34:36 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:36 devstack sudo[89557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 Feb 27 12:34:36 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:37 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4ff3afdf-9fec-44c4-bf43-e9889ead20f7 tempest-CinderUnicodeTest-1627730405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2270c476-9d13-4c03-9fe2-9736535085db" returned: 0 in 0.587s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4ff3afdf-9fec-44c4-bf43-e9889ead20f7 tempest-CinderUnicodeTest-1627730405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2270c476-9d13-4c03-9fe2-9736535085db {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:37 devstack sudo[89566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2270c476-9d13-4c03-9fe2-9736535085db Feb 27 12:34:37 devstack sudo[89566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:37 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_k6q69tpedevstack@QuobyteHD" returned: 0 in 0.494s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Temporary image 9c0a1769-4e00-41fd-a047-783ef98efe34 is fetched for user a2bfea9611784b948bb621696b1937c7. {{(pid=83077) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 12:34:37 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2" returned: 0 in 0.425s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98826f98-b1a2-43f8-905a-88e8a5c5b162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-643444f7-efc6-47d5-ac82-a47d1ee160c2', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13dfaff2-4b95-44df-9ff8-5df30898a237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:37 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Volume volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 (643444f7-efc6-47d5-ac82-a47d1ee160c2): created successfully Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13dfaff2-4b95-44df-9ff8-5df30898a237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Flow 'volume_create_manager' (33141bc6-a1bd-4ce9-bc83-2ba109ceb3ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[689c5360-f5cc-4305-8a2b-3a64282d6b45]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_k6q69tpedevstack@QuobyteHD {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:37 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-8d25a4b6-16f3-4bf1-9723-814af7a5b6f8 tempest-VolumesActionsTest-1655305945 None] Created volume successfully. Feb 27 12:34:37 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_k6q69tpedevstack@QuobyteHD Feb 27 12:34:37 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:37 devstack sudo[89566]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4ff3afdf-9fec-44c4-bf43-e9889ead20f7 tempest-CinderUnicodeTest-1627730405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-2270c476-9d13-4c03-9fe2-9736535085db" returned: 0 in 0.432s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4ff3afdf-9fec-44c4-bf43-e9889ead20f7 tempest-CinderUnicodeTest-1627730405 None] Lock "cinder-quobyte-2270c476-9d13-4c03-9fe2-9736535085db" released by "delete_volume" :: held 1.044s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-4ff3afdf-9fec-44c4-bf43-e9889ead20f7 tempest-CinderUnicodeTest-1627730405 None] Created reservations ['fdaed3cc-57a8-4a4a-97e2-90cfe71b2877', 'ebfd1a5f-8621-47ee-ae3f-79a72b184c3f', '164fecf7-f9a1-4187-a38b-ecdea5d85237', 'b5685e72-ad34-424a-a823-7761a9156cf1'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-4ff3afdf-9fec-44c4-bf43-e9889ead20f7 tempest-CinderUnicodeTest-1627730405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-4ff3afdf-9fec-44c4-bf43-e9889ead20f7 tempest-CinderUnicodeTest-1627730405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-4ff3afdf-9fec-44c4-bf43-e9889ead20f7 tempest-CinderUnicodeTest-1627730405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-4ff3afdf-9fec-44c4-bf43-e9889ead20f7 tempest-CinderUnicodeTest-1627730405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-4ff3afdf-9fec-44c4-bf43-e9889ead20f7 tempest-CinderUnicodeTest-1627730405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4ff3afdf-9fec-44c4-bf43-e9889ead20f7 tempest-CinderUnicodeTest-1627730405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:37 devstack sudo[89574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:34:37 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:37 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_k6q69tpedevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-975532199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9439b762-84b1-4d64-81b7-e2be6c5f23a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e128bd6174e48b0b38cb2f4500798e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:36Z,use_quota=True,user_id='a2bfea9611784b948bb621696b1937c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Creating volume 9439b762-84b1-4d64-81b7-e2be6c5f23a7 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:34:37 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:34:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:37 devstack sudo[89576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 1073741824 Feb 27 12:34:37 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:38 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4ff3afdf-9fec-44c4-bf43-e9889ead20f7 tempest-CinderUnicodeTest-1627730405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.405s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:38 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-4ff3afdf-9fec-44c4-bf43-e9889ead20f7 tempest-CinderUnicodeTest-1627730405 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:34:38 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-4ff3afdf-9fec-44c4-bf43-e9889ead20f7 tempest-CinderUnicodeTest-1627730405 None] Deleted volume successfully. Feb 27 12:34:38 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4ff3afdf-9fec-44c4-bf43-e9889ead20f7 tempest-CinderUnicodeTest-1627730405 None] Lock "cinder-2270c476-9d13-4c03-9fe2-9736535085db-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:38 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 1073741824" returned: 0 in 0.533s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:38 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 Feb 27 12:34:38 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:39 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7" returned: 0 in 0.606s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:39 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:34:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:39 devstack cinder-volume[83077]: DEBUG cinder.volume.volume_utils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Attempting download of 9c0a1769-4e00-41fd-a047-783ef98efe34 ((None, [{'url': 'file:///opt/stack/data/glance/images/9c0a1769-4e00-41fd-a047-783ef98efe34', 'metadata': {}}])) to volume 9439b762-84b1-4d64-81b7-e2be6c5f23a7. {{(pid=83077) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 12:34:39 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c567de35-46e3-4a25-a62a-421c9ef6b5be]: (4, 'raw') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_g6kimrhq {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:39 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_g6kimrhq Feb 27 12:34:39 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:39 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_g6kimrhq" returned: 0 in 0.535s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_g6kimrhq {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:39 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_g6kimrhq Feb 27 12:34:39 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:40 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_g6kimrhq" returned: 1 in 0.587s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c0a1769-4e00-41fd-a047-783ef98efe34_g6kimrhq' failed. Not Retrying. {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:34:40 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a1aa6b-6a8d-4e2f-9ebc-001549d5bf94]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_k6q69tpedevstack@QuobyteHD {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:40 devstack sudo[89596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_k6q69tpedevstack@QuobyteHD Feb 27 12:34:40 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:40 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_k6q69tpedevstack@QuobyteHD" returned: 0 in 0.537s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:40 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] 9c0a1769-4e00-41fd-a047-783ef98efe34 was qcow2, converting to raw {{(pid=83077) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 12:34:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_k6q69tpedevstack@QuobyteHD /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:40 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_k6q69tpedevstack@QuobyteHD /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 Feb 27 12:34:40 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:41 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_k6q69tpedevstack@QuobyteHD /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7" returned: 0 in 1.082s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:41 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9c0a1769-4e00-41fd-a047-783ef98efe34_k6q69tpedevstack@QuobyteHD, size 112.00 MB, duration 1.08 sec, destination /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 {{(pid=83077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:34:41 devstack cinder-volume[83077]: INFO cinder.image.image_utils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Converted 112.00 MB image at 103.41 MB/s Feb 27 12:34:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:41 devstack sudo[89615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 1G Feb 27 12:34:41 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:42 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 1G" returned: 0 in 0.512s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:42 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f571a6-a66a-45e1-987a-7fb5a583b310]: (4, 'raw') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:42 devstack sudo[89621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 Feb 27 12:34:42 devstack sudo[89621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:42 devstack sudo[89621]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7" returned: 0 in 0.514s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:42 devstack sudo[89625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 Feb 27 12:34:42 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:43 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7" returned: 1 in 0.541s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7' failed. Not Retrying. {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:34:43 devstack cinder-volume[83077]: DEBUG cinder.volume.volume_utils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Downloaded image 9c0a1769-4e00-41fd-a047-783ef98efe34 ((None, [{'url': 'file:///opt/stack/data/glance/images/9c0a1769-4e00-41fd-a047-783ef98efe34', 'metadata': {}}])) to volume 9439b762-84b1-4d64-81b7-e2be6c5f23a7 successfully. {{(pid=83077) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 12:34:43 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Temporary image 9c0a1769-4e00-41fd-a047-783ef98efe34 for user a2bfea9611784b948bb621696b1937c7 is deleted. {{(pid=83077) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 12:34:43 devstack cinder-volume[83077]: DEBUG cinder.volume.volume_utils [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Marking volume 9439b762-84b1-4d64-81b7-e2be6c5f23a7 as bootable. {{(pid=83077) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 12:34:43 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Copying metadata from image 9c0a1769-4e00-41fd-a047-783ef98efe34 to 9439b762-84b1-4d64-81b7-e2be6c5f23a7. {{(pid=83077) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 12:34:43 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Creating volume glance metadata for volume 9439b762-84b1-4d64-81b7-e2be6c5f23a7 backed by image 9c0a1769-4e00-41fd-a047-783ef98efe34 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83077) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 12:34:43 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0892c1f-f5b6-4219-add0-b68d9f97440c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7', 'volume_size': 1, 'image_id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c0a1769-4e00-41fd-a047-783ef98efe34', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa6a7971cf2a477f87f22a9fc435f45d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9c0a1769-4e00-41fd-a047-783ef98efe34', 'created_at': datetime.datetime(2026, 2, 27, 11, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 11, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c0a1769-4e00-41fd-a047-783ef98efe34/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:43 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024f6122-702e-4ff0-8582-dcd933049550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:43 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Volume volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 (9439b762-84b1-4d64-81b7-e2be6c5f23a7): created successfully Feb 27 12:34:43 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024f6122-702e-4ff0-8582-dcd933049550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:43 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Flow 'volume_create_manager' (90cce1b6-f183-439b-baeb-44440a333a61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:43 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-07d697bb-3afa-4b0d-bed5-123ebb86ff51 tempest-VolumesExtendTest-333194922 None] Created volume successfully. Feb 27 12:34:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f21f799b-63fd-452f-bd52-3ddc81071428 tempest-VolumesExtendTest-333194922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f21f799b-63fd-452f-bd52-3ddc81071428 tempest-VolumesExtendTest-333194922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:43 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec91e5e3-c3ee-4c4b-870b-c1d4594b4cfe]: (4, 'raw') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f21f799b-63fd-452f-bd52-3ddc81071428 tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:43 devstack sudo[89630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 Feb 27 12:34:43 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:44 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f21f799b-63fd-452f-bd52-3ddc81071428 tempest-VolumesExtendTest-333194922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7" returned: 0 in 0.549s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f21f799b-63fd-452f-bd52-3ddc81071428 tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:44 devstack sudo[89634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 Feb 27 12:34:44 devstack sudo[89634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:44 devstack sudo[89634]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f21f799b-63fd-452f-bd52-3ddc81071428 tempest-VolumesExtendTest-333194922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7" returned: 1 in 0.526s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f21f799b-63fd-452f-bd52-3ddc81071428 tempest-VolumesExtendTest-333194922 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7' failed. Not Retrying. {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:34:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f21f799b-63fd-452f-bd52-3ddc81071428 tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 2G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f21f799b-63fd-452f-bd52-3ddc81071428 tempest-VolumesExtendTest-333194922 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 2G" returned: 0 in 0.056s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f21f799b-63fd-452f-bd52-3ddc81071428 tempest-VolumesExtendTest-333194922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.167s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:44 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-f21f799b-63fd-452f-bd52-3ddc81071428 tempest-VolumesExtendTest-333194922 None] Extend volume completed successfully. Feb 27 12:34:46 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-321ee8e6-7b8e-4576-b4dd-e23ed032d06c tempest-VolumesExtendTest-333194922 None] Acquiring lock "cinder-9439b762-84b1-4d64-81b7-e2be6c5f23a7-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:46 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-321ee8e6-7b8e-4576-b4dd-e23ed032d06c tempest-VolumesExtendTest-333194922 None] Lock "cinder-9439b762-84b1-4d64-81b7-e2be6c5f23a7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:46 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-321ee8e6-7b8e-4576-b4dd-e23ed032d06c tempest-VolumesExtendTest-333194922 None] Acquiring lock "cinder-quobyte-9439b762-84b1-4d64-81b7-e2be6c5f23a7" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:46 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-321ee8e6-7b8e-4576-b4dd-e23ed032d06c tempest-VolumesExtendTest-333194922 None] Lock "cinder-quobyte-9439b762-84b1-4d64-81b7-e2be6c5f23a7" acquired by "delete_volume" :: waited 0.026s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:46 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b7e513-550d-41ee-aa40-2cfe3b04b228]: (4, 'raw') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-321ee8e6-7b8e-4576-b4dd-e23ed032d06c tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:46 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 Feb 27 12:34:46 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:46 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-321ee8e6-7b8e-4576-b4dd-e23ed032d06c tempest-VolumesExtendTest-333194922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7" returned: 0 in 0.476s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-321ee8e6-7b8e-4576-b4dd-e23ed032d06c tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:46 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 Feb 27 12:34:46 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:47 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-321ee8e6-7b8e-4576-b4dd-e23ed032d06c tempest-VolumesExtendTest-333194922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7" returned: 1 in 0.454s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-321ee8e6-7b8e-4576-b4dd-e23ed032d06c tempest-VolumesExtendTest-333194922 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7' failed. Not Retrying. {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:34:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-321ee8e6-7b8e-4576-b4dd-e23ed032d06c tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:47 devstack sudo[89667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7 Feb 27 12:34:47 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:47 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-321ee8e6-7b8e-4576-b4dd-e23ed032d06c tempest-VolumesExtendTest-333194922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-9439b762-84b1-4d64-81b7-e2be6c5f23a7" returned: 0 in 0.563s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:47 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-321ee8e6-7b8e-4576-b4dd-e23ed032d06c tempest-VolumesExtendTest-333194922 None] Lock "cinder-quobyte-9439b762-84b1-4d64-81b7-e2be6c5f23a7" released by "delete_volume" :: held 1.547s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:47 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-321ee8e6-7b8e-4576-b4dd-e23ed032d06c tempest-VolumesExtendTest-333194922 None] Created reservations ['90801ecb-6fd3-4c9f-885f-8b8a5ac05ff6', '49c97542-fa00-42fc-b016-5b3f317f72b2', '1c87dac0-a67a-430d-ac30-739f403913db', 'dcc9cc43-5a7e-42cf-9c03-20637e0ed8e0'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-321ee8e6-7b8e-4576-b4dd-e23ed032d06c tempest-VolumesExtendTest-333194922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-321ee8e6-7b8e-4576-b4dd-e23ed032d06c tempest-VolumesExtendTest-333194922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:47 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-321ee8e6-7b8e-4576-b4dd-e23ed032d06c tempest-VolumesExtendTest-333194922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:47 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-321ee8e6-7b8e-4576-b4dd-e23ed032d06c tempest-VolumesExtendTest-333194922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-321ee8e6-7b8e-4576-b4dd-e23ed032d06c tempest-VolumesExtendTest-333194922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-321ee8e6-7b8e-4576-b4dd-e23ed032d06c tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:47 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:34:47 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:48 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-321ee8e6-7b8e-4576-b4dd-e23ed032d06c tempest-VolumesExtendTest-333194922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.449s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:48 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-321ee8e6-7b8e-4576-b4dd-e23ed032d06c tempest-VolumesExtendTest-333194922 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:34:48 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-321ee8e6-7b8e-4576-b4dd-e23ed032d06c tempest-VolumesExtendTest-333194922 None] Deleted volume successfully. Feb 27 12:34:48 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-321ee8e6-7b8e-4576-b4dd-e23ed032d06c tempest-VolumesExtendTest-333194922 None] Lock "cinder-9439b762-84b1-4d64-81b7-e2be6c5f23a7-delete_volume" released by "delete_volume" :: held 2.183s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:48 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:34:48 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Flow 'volume_create_manager' (873a20a8-16bd-46d8-bef1-1759a3776b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:48 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c9a40c-757f-407f-ab74-cd99a7ede063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:48 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c9a40c-757f-407f-ab74-cd99a7ede063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1256549460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea1831d-ffdd-41d7-b168-f962c3220fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e128bd6174e48b0b38cb2f4500798e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:49Z,use_quota=True,user_id='a2bfea9611784b948bb621696b1937c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:48 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c214c5c2-9c71-4265-8df1-68b10c1a1f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:48 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c214c5c2-9c71-4265-8df1-68b10c1a1f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:48 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc97038-deff-4ee5-bef2-eddc2dc39e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:48 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc97038-deff-4ee5-bef2-eddc2dc39e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eea1831d-ffdd-41d7-b168-f962c3220fd1', 'volume_name': 'volume-eea1831d-ffdd-41d7-b168-f962c3220fd1', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:48 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c97dc54-43e0-41db-8224-57268b288187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:48 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c97dc54-43e0-41db-8224-57268b288187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:48 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d16c62-61e3-44f1-a3de-d65baba1bd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:48 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Volume eea1831d-ffdd-41d7-b168-f962c3220fd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eea1831d-ffdd-41d7-b168-f962c3220fd1', 'volume_size': 1} Feb 27 12:34:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:48 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1256549460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea1831d-ffdd-41d7-b168-f962c3220fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e128bd6174e48b0b38cb2f4500798e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:49Z,use_quota=True,user_id='a2bfea9611784b948bb621696b1937c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:34:48 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Creating volume eea1831d-ffdd-41d7-b168-f962c3220fd1 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:34:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:48 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:48 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:48 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:34:48 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:34:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:48 devstack sudo[89676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1 1073741824 Feb 27 12:34:48 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:49 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1 1073741824" returned: 0 in 0.535s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:49 devstack sudo[89681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1 Feb 27 12:34:49 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:49 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1" returned: 0 in 0.462s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:49 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:34:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:49 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d16c62-61e3-44f1-a3de-d65baba1bd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eea1831d-ffdd-41d7-b168-f962c3220fd1', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:49 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba02ee5b-0442-482c-adbf-f6eea85f89f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:49 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Volume volume-eea1831d-ffdd-41d7-b168-f962c3220fd1 (eea1831d-ffdd-41d7-b168-f962c3220fd1): created successfully Feb 27 12:34:49 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba02ee5b-0442-482c-adbf-f6eea85f89f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:49 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Flow 'volume_create_manager' (873a20a8-16bd-46d8-bef1-1759a3776b89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:49 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-9cab3515-752e-4a64-bbac-c353c6af8efe tempest-VolumesExtendTest-333194922 None] Created volume successfully. Feb 27 12:34:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-9423ba90-ebcb-48e8-bda2-12b4e2570623 tempest-VolumesExtendTest-333194922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-9423ba90-ebcb-48e8-bda2-12b4e2570623 tempest-VolumesExtendTest-333194922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:50 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-9423ba90-ebcb-48e8-bda2-12b4e2570623 tempest-VolumesExtendTest-333194922 None] Creating offline snapshot 3d885f79-daca-49d3-a73c-2c6fe4a9a87b of volume eea1831d-ffdd-41d7-b168-f962c3220fd1 {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:34:50 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[7705f55e-d36a-47ed-9ea0-99519729ed93]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9423ba90-ebcb-48e8-bda2-12b4e2570623 tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:50 devstack sudo[89711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1 Feb 27 12:34:50 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:51 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9423ba90-ebcb-48e8-bda2-12b4e2570623 tempest-VolumesExtendTest-333194922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1" returned: 0 in 0.610s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9423ba90-ebcb-48e8-bda2-12b4e2570623 tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.3d885f79-daca-49d3-a73c-2c6fe4a9a87b 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:51 devstack sudo[89717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.3d885f79-daca-49d3-a73c-2c6fe4a9a87b 1G Feb 27 12:34:51 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:52 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9423ba90-ebcb-48e8-bda2-12b4e2570623 tempest-VolumesExtendTest-333194922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.3d885f79-daca-49d3-a73c-2c6fe4a9a87b 1G" returned: 0 in 0.544s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9423ba90-ebcb-48e8-bda2-12b4e2570623 tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eea1831d-ffdd-41d7-b168-f962c3220fd1 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.3d885f79-daca-49d3-a73c-2c6fe4a9a87b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:52 devstack sudo[89722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eea1831d-ffdd-41d7-b168-f962c3220fd1 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.3d885f79-daca-49d3-a73c-2c6fe4a9a87b Feb 27 12:34:52 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:52 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9423ba90-ebcb-48e8-bda2-12b4e2570623 tempest-VolumesExtendTest-333194922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eea1831d-ffdd-41d7-b168-f962c3220fd1 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.3d885f79-daca-49d3-a73c-2c6fe4a9a87b" returned: 0 in 0.518s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:52 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-9423ba90-ebcb-48e8-bda2-12b4e2570623 tempest-VolumesExtendTest-333194922 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.3d885f79-daca-49d3-a73c-2c6fe4a9a87b is being set with open permissions: ugo+rw Feb 27 12:34:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9423ba90-ebcb-48e8-bda2-12b4e2570623 tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.3d885f79-daca-49d3-a73c-2c6fe4a9a87b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:52 devstack sudo[89727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.3d885f79-daca-49d3-a73c-2c6fe4a9a87b Feb 27 12:34:52 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:52 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b0610fbd-a5e2-43fd-932e-68bc08b8d49c tempest-VolumesActionsTest-1655305945 None] Acquiring lock "cinder-643444f7-efc6-47d5-ac82-a47d1ee160c2" by "attach_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:52 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b0610fbd-a5e2-43fd-932e-68bc08b8d49c tempest-VolumesActionsTest-1655305945 None] Lock "cinder-643444f7-efc6-47d5-ac82-a47d1ee160c2" acquired by "attach_volume" :: waited 0.012s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:52 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-b0610fbd-a5e2-43fd-932e-68bc08b8d49c tempest-VolumesActionsTest-1655305945 None] Attaching volume 643444f7-efc6-47d5-ac82-a47d1ee160c2 to instance 13cd32d4-c807-45af-8f44-c9b4bd637dcb at mountpoint /dev/vdb on host None. Feb 27 12:34:52 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-b0610fbd-a5e2-43fd-932e-68bc08b8d49c tempest-VolumesActionsTest-1655305945 None] Attach volume completed successfully. Feb 27 12:34:52 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-b0610fbd-a5e2-43fd-932e-68bc08b8d49c tempest-VolumesActionsTest-1655305945 None] Lock "cinder-643444f7-efc6-47d5-ac82-a47d1ee160c2" released by "attach_volume" :: held 0.084s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:52 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9423ba90-ebcb-48e8-bda2-12b4e2570623 tempest-VolumesExtendTest-333194922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.3d885f79-daca-49d3-a73c-2c6fe4a9a87b" returned: 0 in 0.432s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9423ba90-ebcb-48e8-bda2-12b4e2570623 tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:53 devstack sudo[89730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.info Feb 27 12:34:53 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:53 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-22ebcab1-d3e5-49e6-b56e-1868dadce0bd tempest-VolumesActionsTest-1655305945 None] Acquiring lock "cinder-643444f7-efc6-47d5-ac82-a47d1ee160c2-detach_volume" by "detach_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:53 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-22ebcab1-d3e5-49e6-b56e-1868dadce0bd tempest-VolumesActionsTest-1655305945 None] Lock "cinder-643444f7-efc6-47d5-ac82-a47d1ee160c2-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:53 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-22ebcab1-d3e5-49e6-b56e-1868dadce0bd tempest-VolumesActionsTest-1655305945 None] Detaching volume 643444f7-efc6-47d5-ac82-a47d1ee160c2 from instance 13cd32d4-c807-45af-8f44-c9b4bd637dcb. Feb 27 12:34:53 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-22ebcab1-d3e5-49e6-b56e-1868dadce0bd tempest-VolumesActionsTest-1655305945 None] Detach volume completed successfully. Feb 27 12:34:53 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-22ebcab1-d3e5-49e6-b56e-1868dadce0bd tempest-VolumesActionsTest-1655305945 None] Lock "cinder-643444f7-efc6-47d5-ac82-a47d1ee160c2-detach_volume" released by "detach_volume" :: held 0.051s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:53 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9423ba90-ebcb-48e8-bda2-12b4e2570623 tempest-VolumesExtendTest-333194922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.info" returned: 0 in 0.480s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:53 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-9423ba90-ebcb-48e8-bda2-12b4e2570623 tempest-VolumesExtendTest-333194922 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.info is being set with open permissions: ugo+rw Feb 27 12:34:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9423ba90-ebcb-48e8-bda2-12b4e2570623 tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:53 devstack sudo[89733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.info Feb 27 12:34:53 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:54 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9423ba90-ebcb-48e8-bda2-12b4e2570623 tempest-VolumesExtendTest-333194922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.info" returned: 0 in 0.522s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-9423ba90-ebcb-48e8-bda2-12b4e2570623 tempest-VolumesExtendTest-333194922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.172s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:54 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-9423ba90-ebcb-48e8-bda2-12b4e2570623 tempest-VolumesExtendTest-333194922 None] Create snapshot completed successfully Feb 27 12:34:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-fff0965e-a38f-48f3-8ad3-aff1036de732 tempest-VolumesExtendTest-333194922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-fff0965e-a38f-48f3-8ad3-aff1036de732 tempest-VolumesExtendTest-333194922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:55 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f3d4d6-4c13-4442-96d7-e3c4ababe5b2]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-fff0965e-a38f-48f3-8ad3-aff1036de732 tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:55 devstack sudo[89744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1 Feb 27 12:34:55 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:55 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-fff0965e-a38f-48f3-8ad3-aff1036de732 tempest-VolumesExtendTest-333194922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1" returned: 0 in 0.627s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-fff0965e-a38f-48f3-8ad3-aff1036de732 tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.3d885f79-daca-49d3-a73c-2c6fe4a9a87b 2G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-fff0965e-a38f-48f3-8ad3-aff1036de732 tempest-VolumesExtendTest-333194922 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.3d885f79-daca-49d3-a73c-2c6fe4a9a87b 2G" returned: 0 in 0.077s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-fff0965e-a38f-48f3-8ad3-aff1036de732 tempest-VolumesExtendTest-333194922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.726s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:55 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-fff0965e-a38f-48f3-8ad3-aff1036de732 tempest-VolumesExtendTest-333194922 None] Extend volume completed successfully. Feb 27 12:34:56 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8db6651a-f817-4269-ae63-f6b31aa91b95 tempest-VolumesExtendTest-333194922 None] Acquiring lock "cinder-3d885f79-daca-49d3-a73c-2c6fe4a9a87b-delete_snapshot" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:56 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8db6651a-f817-4269-ae63-f6b31aa91b95 tempest-VolumesExtendTest-333194922 None] Lock "cinder-3d885f79-daca-49d3-a73c-2c6fe4a9a87b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:56 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8db6651a-f817-4269-ae63-f6b31aa91b95 tempest-VolumesExtendTest-333194922 None] Acquiring lock "cinder-quobyte-eea1831d-ffdd-41d7-b168-f962c3220fd1" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:56 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8db6651a-f817-4269-ae63-f6b31aa91b95 tempest-VolumesExtendTest-333194922 None] Lock "cinder-quobyte-eea1831d-ffdd-41d7-b168-f962c3220fd1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:56 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8db6651a-f817-4269-ae63-f6b31aa91b95 tempest-VolumesExtendTest-333194922 None] Acquiring lock "cinder-quobyte-3d885f79-daca-49d3-a73c-2c6fe4a9a87b" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:56 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8db6651a-f817-4269-ae63-f6b31aa91b95 tempest-VolumesExtendTest-333194922 None] Lock "cinder-quobyte-3d885f79-daca-49d3-a73c-2c6fe4a9a87b" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:56 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-8db6651a-f817-4269-ae63-f6b31aa91b95 tempest-VolumesExtendTest-333194922 None] Deleting offline snapshot 3d885f79-daca-49d3-a73c-2c6fe4a9a87b of volume eea1831d-ffdd-41d7-b168-f962c3220fd1 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:34:56 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-8db6651a-f817-4269-ae63-f6b31aa91b95 tempest-VolumesExtendTest-333194922 None] snapshot_file for this snap is: volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.3d885f79-daca-49d3-a73c-2c6fe4a9a87b {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:34:56 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[123b3c3a-2a89-4dde-b776-18698ff8dde8]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8db6651a-f817-4269-ae63-f6b31aa91b95 tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.3d885f79-daca-49d3-a73c-2c6fe4a9a87b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:56 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.3d885f79-daca-49d3-a73c-2c6fe4a9a87b Feb 27 12:34:56 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Flow 'volume_create_manager' (3e224e9b-e07f-47a1-84eb-191348c3e294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34470ee0-8c42-47b9-a7e8-a1ca126d93fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34470ee0-8c42-47b9-a7e8-a1ca126d93fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1828093883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12908f43-5ca5-4ff6-b942-9325e1cbb29d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff42f819fc9d450c9d0ce9f9d1f7ceb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:57Z,use_quota=True,user_id='2ce53c08580442bd8e2668d859ad934f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a8c7545-e756-4176-9ff5-f5a7590be4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a8c7545-e756-4176-9ff5-f5a7590be4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60d3ea9-5b95-4e52-a5c6-83ae4716c574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60d3ea9-5b95-4e52-a5c6-83ae4716c574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12908f43-5ca5-4ff6-b942-9325e1cbb29d', 'volume_name': 'volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4482130d-0934-4ce7-b813-b55c345cc6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4482130d-0934-4ce7-b813-b55c345cc6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d08125-2184-46cd-90eb-fec94d1b305f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:57 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Volume 12908f43-5ca5-4ff6-b942-9325e1cbb29d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d', 'volume_size': 1} Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1828093883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12908f43-5ca5-4ff6-b942-9325e1cbb29d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff42f819fc9d450c9d0ce9f9d1f7ceb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:57Z,use_quota=True,user_id='2ce53c08580442bd8e2668d859ad934f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Creating volume 12908f43-5ca5-4ff6-b942-9325e1cbb29d {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:34:57 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:57 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8db6651a-f817-4269-ae63-f6b31aa91b95 tempest-VolumesExtendTest-333194922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.3d885f79-daca-49d3-a73c-2c6fe4a9a87b" returned: 0 in 0.712s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-8db6651a-f817-4269-ae63-f6b31aa91b95 tempest-VolumesExtendTest-333194922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eea1831d-ffdd-41d7-b168-f962c3220fd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:34:57 devstack sudo[89777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d 1073741824 Feb 27 12:34:57 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[19097814-85e5-4ab1-aa6f-b19380070827]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8db6651a-f817-4269-ae63-f6b31aa91b95 tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:57 devstack sudo[89779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1 Feb 27 12:34:57 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:57 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d 1073741824" returned: 0 in 0.530s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:57 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d Feb 27 12:34:57 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:57 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8db6651a-f817-4269-ae63-f6b31aa91b95 tempest-VolumesExtendTest-333194922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1" returned: 0 in 0.558s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8db6651a-f817-4269-ae63-f6b31aa91b95 tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.3d885f79-daca-49d3-a73c-2c6fe4a9a87b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:57 devstack sudo[89790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.3d885f79-daca-49d3-a73c-2c6fe4a9a87b Feb 27 12:34:57 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:58 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d" returned: 0 in 0.431s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:34:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:58 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d08125-2184-46cd-90eb-fec94d1b305f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:58 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc8f0bd-e11d-414f-a074-3c83f7306ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:58 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Volume volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d (12908f43-5ca5-4ff6-b942-9325e1cbb29d): created successfully Feb 27 12:34:58 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc8f0bd-e11d-414f-a074-3c83f7306ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:58 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Flow 'volume_create_manager' (3e224e9b-e07f-47a1-84eb-191348c3e294) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:58 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-77a2632f-d031-4b66-bda8-50f8c9095100 tempest-SnapshotDependencyTests-1219387437 None] Created volume successfully. Feb 27 12:34:58 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8db6651a-f817-4269-ae63-f6b31aa91b95 tempest-VolumesExtendTest-333194922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.3d885f79-daca-49d3-a73c-2c6fe4a9a87b" returned: 0 in 0.502s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8db6651a-f817-4269-ae63-f6b31aa91b95 tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.3d885f79-daca-49d3-a73c-2c6fe4a9a87b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:58 devstack sudo[89796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.3d885f79-daca-49d3-a73c-2c6fe4a9a87b Feb 27 12:34:58 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:58 devstack cinder-volume[83077]: DEBUG oslo_service.periodic_task [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83077) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 12:34:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:58 devstack sudo[89798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:34:58 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:58 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8db6651a-f817-4269-ae63-f6b31aa91b95 tempest-VolumesExtendTest-333194922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1.3d885f79-daca-49d3-a73c-2c6fe4a9a87b" returned: 0 in 0.388s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:58 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8db6651a-f817-4269-ae63-f6b31aa91b95 tempest-VolumesExtendTest-333194922 None] Lock "cinder-quobyte-3d885f79-daca-49d3-a73c-2c6fe4a9a87b" released by "_delete_snapshot" :: held 2.234s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:58 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8db6651a-f817-4269-ae63-f6b31aa91b95 tempest-VolumesExtendTest-333194922 None] Lock "cinder-quobyte-eea1831d-ffdd-41d7-b168-f962c3220fd1" released by "delete_snapshot" :: held 2.246s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:58 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-8db6651a-f817-4269-ae63-f6b31aa91b95 tempest-VolumesExtendTest-333194922 None] Created reservations ['5bcec6a2-c6f8-4f17-baa4-f44c3b157eb4', '60a4936c-e217-49a7-8b45-10f4d1600eaa', 'bbe4a4a6-3797-461a-8287-e0d074a71db2', '2fe4f142-867e-4799-b9d6-15f8908eed4f'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:58 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-8db6651a-f817-4269-ae63-f6b31aa91b95 tempest-VolumesExtendTest-333194922 None] Delete snapshot completed successfully. Feb 27 12:34:58 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8db6651a-f817-4269-ae63-f6b31aa91b95 tempest-VolumesExtendTest-333194922 None] Lock "cinder-3d885f79-daca-49d3-a73c-2c6fe4a9a87b-delete_snapshot" released by "delete_snapshot" :: held 2.342s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:58 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.403s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:58 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:34:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-35657eb6-a8aa-4205-9020-6644420b7843 tempest-SnapshotDependencyTests-1219387437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-35657eb6-a8aa-4205-9020-6644420b7843 tempest-SnapshotDependencyTests-1219387437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:59 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-35657eb6-a8aa-4205-9020-6644420b7843 tempest-SnapshotDependencyTests-1219387437 None] Creating offline snapshot 386cc1d5-c61b-45cc-82eb-0f801b87b18c of volume 12908f43-5ca5-4ff6-b942-9325e1cbb29d {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:34:59 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4615b21-8241-49e8-947a-42a3bf6b471f]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-35657eb6-a8aa-4205-9020-6644420b7843 tempest-SnapshotDependencyTests-1219387437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:59 devstack sudo[89802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d Feb 27 12:34:59 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:59 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-12ac0ed3-bf2f-433c-9cb9-49b48239aaef tempest-VolumesExtendTest-333194922 None] Acquiring lock "cinder-eea1831d-ffdd-41d7-b168-f962c3220fd1-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:59 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-12ac0ed3-bf2f-433c-9cb9-49b48239aaef tempest-VolumesExtendTest-333194922 None] Lock "cinder-eea1831d-ffdd-41d7-b168-f962c3220fd1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:59 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-12ac0ed3-bf2f-433c-9cb9-49b48239aaef tempest-VolumesExtendTest-333194922 None] Acquiring lock "cinder-quobyte-eea1831d-ffdd-41d7-b168-f962c3220fd1" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:59 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-12ac0ed3-bf2f-433c-9cb9-49b48239aaef tempest-VolumesExtendTest-333194922 None] Lock "cinder-quobyte-eea1831d-ffdd-41d7-b168-f962c3220fd1" acquired by "delete_volume" :: waited 0.007s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:59 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f177350-4c8e-4930-9bc5-1e4f2603f688]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12ac0ed3-bf2f-433c-9cb9-49b48239aaef tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:59 devstack sudo[89804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1 Feb 27 12:34:59 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:59 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-35657eb6-a8aa-4205-9020-6644420b7843 tempest-SnapshotDependencyTests-1219387437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d" returned: 0 in 0.473s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-35657eb6-a8aa-4205-9020-6644420b7843 tempest-SnapshotDependencyTests-1219387437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.386cc1d5-c61b-45cc-82eb-0f801b87b18c 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:59 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.386cc1d5-c61b-45cc-82eb-0f801b87b18c 1G Feb 27 12:34:59 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:00 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12ac0ed3-bf2f-433c-9cb9-49b48239aaef tempest-VolumesExtendTest-333194922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1" returned: 0 in 0.478s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12ac0ed3-bf2f-433c-9cb9-49b48239aaef tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:00 devstack sudo[89817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1 Feb 27 12:35:00 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:00 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-35657eb6-a8aa-4205-9020-6644420b7843 tempest-SnapshotDependencyTests-1219387437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.386cc1d5-c61b-45cc-82eb-0f801b87b18c 1G" returned: 0 in 0.480s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-35657eb6-a8aa-4205-9020-6644420b7843 tempest-SnapshotDependencyTests-1219387437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.386cc1d5-c61b-45cc-82eb-0f801b87b18c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:00 devstack sudo[89819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.386cc1d5-c61b-45cc-82eb-0f801b87b18c Feb 27 12:35:00 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:00 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12ac0ed3-bf2f-433c-9cb9-49b48239aaef tempest-VolumesExtendTest-333194922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-eea1831d-ffdd-41d7-b168-f962c3220fd1" returned: 0 in 0.414s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:00 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-12ac0ed3-bf2f-433c-9cb9-49b48239aaef tempest-VolumesExtendTest-333194922 None] Lock "cinder-quobyte-eea1831d-ffdd-41d7-b168-f962c3220fd1" released by "delete_volume" :: held 0.929s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:00 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-12ac0ed3-bf2f-433c-9cb9-49b48239aaef tempest-VolumesExtendTest-333194922 None] Created reservations ['68bf3318-ad8f-45e7-a8c4-bc41c8a70481', '3ae1b78b-4af0-4c24-b480-698b077a923c', '181742ca-fe8d-49cc-9405-f79e1012e899', '8e1bb2d7-3720-4ba9-bd96-3a4dcf63e3ad'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:35:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-12ac0ed3-bf2f-433c-9cb9-49b48239aaef tempest-VolumesExtendTest-333194922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-12ac0ed3-bf2f-433c-9cb9-49b48239aaef tempest-VolumesExtendTest-333194922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:00 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-12ac0ed3-bf2f-433c-9cb9-49b48239aaef tempest-VolumesExtendTest-333194922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:00 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-12ac0ed3-bf2f-433c-9cb9-49b48239aaef tempest-VolumesExtendTest-333194922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-12ac0ed3-bf2f-433c-9cb9-49b48239aaef tempest-VolumesExtendTest-333194922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12ac0ed3-bf2f-433c-9cb9-49b48239aaef tempest-VolumesExtendTest-333194922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:00 devstack sudo[89825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:35:00 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:00 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-35657eb6-a8aa-4205-9020-6644420b7843 tempest-SnapshotDependencyTests-1219387437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.386cc1d5-c61b-45cc-82eb-0f801b87b18c" returned: 0 in 0.424s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:00 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-35657eb6-a8aa-4205-9020-6644420b7843 tempest-SnapshotDependencyTests-1219387437 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.386cc1d5-c61b-45cc-82eb-0f801b87b18c is being set with open permissions: ugo+rw Feb 27 12:35:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-35657eb6-a8aa-4205-9020-6644420b7843 tempest-SnapshotDependencyTests-1219387437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.386cc1d5-c61b-45cc-82eb-0f801b87b18c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:00 devstack sudo[89827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.386cc1d5-c61b-45cc-82eb-0f801b87b18c Feb 27 12:35:00 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:01 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-12ac0ed3-bf2f-433c-9cb9-49b48239aaef tempest-VolumesExtendTest-333194922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.440s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:01 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-12ac0ed3-bf2f-433c-9cb9-49b48239aaef tempest-VolumesExtendTest-333194922 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:35:01 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-12ac0ed3-bf2f-433c-9cb9-49b48239aaef tempest-VolumesExtendTest-333194922 None] Deleted volume successfully. Feb 27 12:35:01 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-12ac0ed3-bf2f-433c-9cb9-49b48239aaef tempest-VolumesExtendTest-333194922 None] Lock "cinder-eea1831d-ffdd-41d7-b168-f962c3220fd1-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:01 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-35657eb6-a8aa-4205-9020-6644420b7843 tempest-SnapshotDependencyTests-1219387437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.386cc1d5-c61b-45cc-82eb-0f801b87b18c" returned: 0 in 0.431s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-35657eb6-a8aa-4205-9020-6644420b7843 tempest-SnapshotDependencyTests-1219387437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:01 devstack sudo[89832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.info Feb 27 12:35:01 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:01 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-35657eb6-a8aa-4205-9020-6644420b7843 tempest-SnapshotDependencyTests-1219387437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.info" returned: 0 in 0.435s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:01 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-35657eb6-a8aa-4205-9020-6644420b7843 tempest-SnapshotDependencyTests-1219387437 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.info is being set with open permissions: ugo+rw Feb 27 12:35:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-35657eb6-a8aa-4205-9020-6644420b7843 tempest-SnapshotDependencyTests-1219387437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:01 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.info Feb 27 12:35:01 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:02 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-35657eb6-a8aa-4205-9020-6644420b7843 tempest-SnapshotDependencyTests-1219387437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.info" returned: 0 in 0.515s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-35657eb6-a8aa-4205-9020-6644420b7843 tempest-SnapshotDependencyTests-1219387437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.828s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:02 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-35657eb6-a8aa-4205-9020-6644420b7843 tempest-SnapshotDependencyTests-1219387437 None] Create snapshot completed successfully Feb 27 12:35:02 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:35:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Flow 'volume_create_manager' (faf5a492-1972-4011-ad59-c37a0b865bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:35:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0af4038-506f-487a-93dc-5b515d3fc75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0af4038-506f-487a-93dc-5b515d3fc75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d925111a-cfe8-4da8-8c6a-6e0417c97457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff42f819fc9d450c9d0ce9f9d1f7ceb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=386cc1d5-c61b-45cc-82eb-0f801b87b18c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:35:03Z,use_quota=True,user_id='2ce53c08580442bd8e2668d859ad934f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aa0e322-b5f7-474d-a641-5dceae765c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aa0e322-b5f7-474d-a641-5dceae765c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e39317-43a9-4b52-96fb-2292007799c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e39317-43a9-4b52-96fb-2292007799c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd925111a-cfe8-4da8-8c6a-6e0417c97457', 'volume_name': 'volume-d925111a-cfe8-4da8-8c6a-6e0417c97457', 'volume_size': 1, 'snapshot_id': '386cc1d5-c61b-45cc-82eb-0f801b87b18c'}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a6b032-ca80-40da-b537-1d0661945cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a6b032-ca80-40da-b537-1d0661945cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39079777-bb55-4b3f-8ffd-cb1954d0bb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:03 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Volume d925111a-cfe8-4da8-8c6a-6e0417c97457: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d925111a-cfe8-4da8-8c6a-6e0417c97457', 'volume_size': 1, 'snapshot_id': '386cc1d5-c61b-45cc-82eb-0f801b87b18c'} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Acquiring lock "cinder-quobyte-386cc1d5-c61b-45cc-82eb-0f801b87b18c-d925111a-cfe8-4da8-8c6a-6e0417c97457" by "_create_volume_from_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Lock "cinder-quobyte-386cc1d5-c61b-45cc-82eb-0f801b87b18c-d925111a-cfe8-4da8-8c6a-6e0417c97457" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Creating volume d925111a-cfe8-4da8-8c6a-6e0417c97457 from snapshot 386cc1d5-c61b-45cc-82eb-0f801b87b18c {{(pid=83077) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Acquiring lock "cinder-quobyte-d925111a-cfe8-4da8-8c6a-6e0417c97457" by "_copy_volume_from_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Lock "cinder-quobyte-d925111a-cfe8-4da8-8c6a-6e0417c97457" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] snapshot: 386cc1d5-c61b-45cc-82eb-0f801b87b18c, volume: d925111a-cfe8-4da8-8c6a-6e0417c97457, {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7efa45-1106-42ba-9275-ef93507b289c]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.386cc1d5-c61b-45cc-82eb-0f801b87b18c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:03 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.386cc1d5-c61b-45cc-82eb-0f801b87b18c Feb 27 12:35:03 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:03 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.386cc1d5-c61b-45cc-82eb-0f801b87b18c" returned: 0 in 0.597s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Creating direct copy from snapshot {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2babff-5bd7-4674-91f9-e3493fd247b9]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:03 devstack sudo[89845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d Feb 27 12:35:03 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:04 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d" returned: 0 in 0.478s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:04 devstack cinder-volume[83077]: DEBUG cinder.utils [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Path /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d925111a-cfe8-4da8-8c6a-6e0417c97457 not found in is_blk_device check {{(pid=83077) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 12:35:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d925111a-cfe8-4da8-8c6a-6e0417c97457 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:04 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d925111a-cfe8-4da8-8c6a-6e0417c97457 Feb 27 12:35:04 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:04 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:35:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Flow 'volume_create_manager' (d3465259-d47c-49b9-86d4-ee6c74cb58eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:35:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b92aab8-6ef8-49fc-a9e4-945b42ebdea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b92aab8-6ef8-49fc-a9e4-945b42ebdea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1116784668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77242436-9bbe-45c2-b5e5-6083c3a8fb3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50b0c1e4424e42ff9582f24696bc3486',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:35:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:35:05Z,use_quota=True,user_id='f00c6b0ee0af4032910ec1035502cb3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5522972-f879-43bb-9d3c-1e0abc21858a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5522972-f879-43bb-9d3c-1e0abc21858a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e119632-8e88-4403-8e37-b1acf0857949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e119632-8e88-4403-8e37-b1acf0857949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77242436-9bbe-45c2-b5e5-6083c3a8fb3f', 'volume_name': 'volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f', 'volume_size': 2}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d9cbcb-03ee-42fb-92c3-3a206a15cade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d9cbcb-03ee-42fb-92c3-3a206a15cade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2296548-9ed4-4f57-a029-2242aa718d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:04 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Volume 77242436-9bbe-45c2-b5e5-6083c3a8fb3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f', 'volume_size': 2} Feb 27 12:35:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:06 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d925111a-cfe8-4da8-8c6a-6e0417c97457" returned: 0 in 1.899s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:06 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e73b4d8-41c9-4f1c-abf2-0a9e156d9d38]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:06 devstack sudo[89862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d Feb 27 12:35:06 devstack sudo[89862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:06 devstack sudo[89862]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d" returned: 0 in 0.585s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:06 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Image conversion details: src /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d, size 1024.00 MB, duration 1.90 sec, destination /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d925111a-cfe8-4da8-8c6a-6e0417c97457 {{(pid=83077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:35:06 devstack cinder-volume[83077]: INFO cinder.image.image_utils [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Converted 1024.00 MB image at 538.92 MB/s Feb 27 12:35:06 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d925111a-cfe8-4da8-8c6a-6e0417c97457 is being set with open permissions: ugo+rw Feb 27 12:35:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d925111a-cfe8-4da8-8c6a-6e0417c97457 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:06 devstack sudo[89867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d925111a-cfe8-4da8-8c6a-6e0417c97457 Feb 27 12:35:06 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:07 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d925111a-cfe8-4da8-8c6a-6e0417c97457" returned: 0 in 0.438s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Lock "cinder-quobyte-d925111a-cfe8-4da8-8c6a-6e0417c97457" released by "_copy_volume_from_snapshot" :: held 4.062s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Lock "cinder-quobyte-386cc1d5-c61b-45cc-82eb-0f801b87b18c-d925111a-cfe8-4da8-8c6a-6e0417c97457" released by "_create_volume_from_snapshot" :: held 4.081s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.091s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.482s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:07 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1116784668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77242436-9bbe-45c2-b5e5-6083c3a8fb3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50b0c1e4424e42ff9582f24696bc3486',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:35:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:35:05Z,use_quota=True,user_id='f00c6b0ee0af4032910ec1035502cb3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:35:07 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Creating volume 77242436-9bbe-45c2-b5e5-6083c3a8fb3f {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:35:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:07 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:07 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:07 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:35:07 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:35:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f 2147483648 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:07 devstack sudo[89870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f 2147483648 Feb 27 12:35:07 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39079777-bb55-4b3f-8ffd-cb1954d0bb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d925111a-cfe8-4da8-8c6a-6e0417c97457', 'volume_size': 1, 'snapshot_id': '386cc1d5-c61b-45cc-82eb-0f801b87b18c'}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08615639-35a4-4118-a482-0b78eda1522d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:07 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Volume volume-d925111a-cfe8-4da8-8c6a-6e0417c97457 (d925111a-cfe8-4da8-8c6a-6e0417c97457): created successfully Feb 27 12:35:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08615639-35a4-4118-a482-0b78eda1522d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:07 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Flow 'volume_create_manager' (faf5a492-1972-4011-ad59-c37a0b865bd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:35:07 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-59ac5d9e-fc30-4433-9351-7b32d49b744f tempest-SnapshotDependencyTests-1219387437 None] Created volume successfully. Feb 27 12:35:07 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f 2147483648" returned: 0 in 0.540s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:07 devstack sudo[89875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f Feb 27 12:35:07 devstack sudo[89875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:08 devstack sudo[89875]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f" returned: 0 in 0.458s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:08 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:35:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:08 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2296548-9ed4-4f57-a029-2242aa718d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f', 'volume_size': 2}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:08 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b270b0ac-0e35-4f51-8aab-69de0a1c682d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:08 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Volume volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f (77242436-9bbe-45c2-b5e5-6083c3a8fb3f): created successfully Feb 27 12:35:08 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b270b0ac-0e35-4f51-8aab-69de0a1c682d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:08 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Flow 'volume_create_manager' (d3465259-d47c-49b9-86d4-ee6c74cb58eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:35:08 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-3d3e15df-f335-4911-a5d7-2e523852aef5 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Created volume successfully. Feb 27 12:35:08 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-40e8da7b-d1a7-4be2-870b-dee4beeb1f53 tempest-SnapshotDependencyTests-1219387437 None] Acquiring lock "cinder-386cc1d5-c61b-45cc-82eb-0f801b87b18c-delete_snapshot" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:08 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-40e8da7b-d1a7-4be2-870b-dee4beeb1f53 tempest-SnapshotDependencyTests-1219387437 None] Lock "cinder-386cc1d5-c61b-45cc-82eb-0f801b87b18c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:08 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-40e8da7b-d1a7-4be2-870b-dee4beeb1f53 tempest-SnapshotDependencyTests-1219387437 None] Acquiring lock "cinder-quobyte-12908f43-5ca5-4ff6-b942-9325e1cbb29d" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:08 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-40e8da7b-d1a7-4be2-870b-dee4beeb1f53 tempest-SnapshotDependencyTests-1219387437 None] Lock "cinder-quobyte-12908f43-5ca5-4ff6-b942-9325e1cbb29d" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:08 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-40e8da7b-d1a7-4be2-870b-dee4beeb1f53 tempest-SnapshotDependencyTests-1219387437 None] Acquiring lock "cinder-quobyte-386cc1d5-c61b-45cc-82eb-0f801b87b18c" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:08 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-40e8da7b-d1a7-4be2-870b-dee4beeb1f53 tempest-SnapshotDependencyTests-1219387437 None] Lock "cinder-quobyte-386cc1d5-c61b-45cc-82eb-0f801b87b18c" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:08 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-40e8da7b-d1a7-4be2-870b-dee4beeb1f53 tempest-SnapshotDependencyTests-1219387437 None] Deleting offline snapshot 386cc1d5-c61b-45cc-82eb-0f801b87b18c of volume 12908f43-5ca5-4ff6-b942-9325e1cbb29d {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:35:08 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-40e8da7b-d1a7-4be2-870b-dee4beeb1f53 tempest-SnapshotDependencyTests-1219387437 None] snapshot_file for this snap is: volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.386cc1d5-c61b-45cc-82eb-0f801b87b18c {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:35:08 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a29f3dc-d473-42e3-bab8-18f1dc9444a0]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-40e8da7b-d1a7-4be2-870b-dee4beeb1f53 tempest-SnapshotDependencyTests-1219387437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.386cc1d5-c61b-45cc-82eb-0f801b87b18c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:08 devstack sudo[89879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.386cc1d5-c61b-45cc-82eb-0f801b87b18c Feb 27 12:35:08 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ab19dadd-d9db-4a54-9b0e-fb060af27c8d tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ab19dadd-d9db-4a54-9b0e-fb060af27c8d tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:09 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-ab19dadd-d9db-4a54-9b0e-fb060af27c8d tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Creating offline snapshot dd47e25e-f76e-4994-9461-7f849a1a61dd of volume 77242436-9bbe-45c2-b5e5-6083c3a8fb3f {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:35:09 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-40e8da7b-d1a7-4be2-870b-dee4beeb1f53 tempest-SnapshotDependencyTests-1219387437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.386cc1d5-c61b-45cc-82eb-0f801b87b18c" returned: 0 in 0.528s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:09 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-40e8da7b-d1a7-4be2-870b-dee4beeb1f53 tempest-SnapshotDependencyTests-1219387437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:35:09 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f1b749-a514-4d43-bfb2-6fb4a6ae0174]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ab19dadd-d9db-4a54-9b0e-fb060af27c8d tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:09 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72e481b-993b-4c30-bbf4-7289de89a765]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-40e8da7b-d1a7-4be2-870b-dee4beeb1f53 tempest-SnapshotDependencyTests-1219387437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:09 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f Feb 27 12:35:09 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:09 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d Feb 27 12:35:09 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:09 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-40e8da7b-d1a7-4be2-870b-dee4beeb1f53 tempest-SnapshotDependencyTests-1219387437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d" returned: 0 in 0.457s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-40e8da7b-d1a7-4be2-870b-dee4beeb1f53 tempest-SnapshotDependencyTests-1219387437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.386cc1d5-c61b-45cc-82eb-0f801b87b18c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:09 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ab19dadd-d9db-4a54-9b0e-fb060af27c8d tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f" returned: 0 in 0.478s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ab19dadd-d9db-4a54-9b0e-fb060af27c8d tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f.dd47e25e-f76e-4994-9461-7f849a1a61dd 2G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:09 devstack sudo[89909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.386cc1d5-c61b-45cc-82eb-0f801b87b18c Feb 27 12:35:09 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:09 devstack sudo[89910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f.dd47e25e-f76e-4994-9461-7f849a1a61dd 2G Feb 27 12:35:09 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:09 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-40e8da7b-d1a7-4be2-870b-dee4beeb1f53 tempest-SnapshotDependencyTests-1219387437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.386cc1d5-c61b-45cc-82eb-0f801b87b18c" returned: 0 in 0.444s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-40e8da7b-d1a7-4be2-870b-dee4beeb1f53 tempest-SnapshotDependencyTests-1219387437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.386cc1d5-c61b-45cc-82eb-0f801b87b18c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:09 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ab19dadd-d9db-4a54-9b0e-fb060af27c8d tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f.dd47e25e-f76e-4994-9461-7f849a1a61dd 2G" returned: 0 in 0.453s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ab19dadd-d9db-4a54-9b0e-fb060af27c8d tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f.dd47e25e-f76e-4994-9461-7f849a1a61dd {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:09 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.386cc1d5-c61b-45cc-82eb-0f801b87b18c Feb 27 12:35:09 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:10 devstack sudo[89921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f.dd47e25e-f76e-4994-9461-7f849a1a61dd Feb 27 12:35:10 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:10 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-40e8da7b-d1a7-4be2-870b-dee4beeb1f53 tempest-SnapshotDependencyTests-1219387437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d.386cc1d5-c61b-45cc-82eb-0f801b87b18c" returned: 0 in 0.446s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-40e8da7b-d1a7-4be2-870b-dee4beeb1f53 tempest-SnapshotDependencyTests-1219387437 None] Lock "cinder-quobyte-386cc1d5-c61b-45cc-82eb-0f801b87b18c" released by "_delete_snapshot" :: held 1.932s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:10 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-40e8da7b-d1a7-4be2-870b-dee4beeb1f53 tempest-SnapshotDependencyTests-1219387437 None] Lock "cinder-quobyte-12908f43-5ca5-4ff6-b942-9325e1cbb29d" released by "delete_snapshot" :: held 1.943s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ab19dadd-d9db-4a54-9b0e-fb060af27c8d tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f.dd47e25e-f76e-4994-9461-7f849a1a61dd" returned: 0 in 0.455s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:10 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-ab19dadd-d9db-4a54-9b0e-fb060af27c8d tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f.dd47e25e-f76e-4994-9461-7f849a1a61dd is being set with open permissions: ugo+rw Feb 27 12:35:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ab19dadd-d9db-4a54-9b0e-fb060af27c8d tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f.dd47e25e-f76e-4994-9461-7f849a1a61dd {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:10 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f.dd47e25e-f76e-4994-9461-7f849a1a61dd Feb 27 12:35:10 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:10 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-40e8da7b-d1a7-4be2-870b-dee4beeb1f53 tempest-SnapshotDependencyTests-1219387437 None] Created reservations ['ed7dd318-2540-41a0-961f-0a49a633a4ec', 'c5028098-b7d0-4d96-9d87-65ec4191948a', '0f84d4a0-04a6-41b3-8616-1a73184ab9c1', '11f2b8e7-d5fd-46e0-abad-77c70f8bbae0'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:35:10 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-40e8da7b-d1a7-4be2-870b-dee4beeb1f53 tempest-SnapshotDependencyTests-1219387437 None] Delete snapshot completed successfully. Feb 27 12:35:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-40e8da7b-d1a7-4be2-870b-dee4beeb1f53 tempest-SnapshotDependencyTests-1219387437 None] Lock "cinder-386cc1d5-c61b-45cc-82eb-0f801b87b18c-delete_snapshot" released by "delete_snapshot" :: held 2.030s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f131cbec-d557-4cac-b0ce-cbf80b36b5d8 tempest-SnapshotDependencyTests-1219387437 None] Acquiring lock "cinder-12908f43-5ca5-4ff6-b942-9325e1cbb29d-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f131cbec-d557-4cac-b0ce-cbf80b36b5d8 tempest-SnapshotDependencyTests-1219387437 None] Lock "cinder-12908f43-5ca5-4ff6-b942-9325e1cbb29d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f131cbec-d557-4cac-b0ce-cbf80b36b5d8 tempest-SnapshotDependencyTests-1219387437 None] Acquiring lock "cinder-quobyte-12908f43-5ca5-4ff6-b942-9325e1cbb29d" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f131cbec-d557-4cac-b0ce-cbf80b36b5d8 tempest-SnapshotDependencyTests-1219387437 None] Lock "cinder-quobyte-12908f43-5ca5-4ff6-b942-9325e1cbb29d" acquired by "delete_volume" :: waited 0.006s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:10 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2db7c47-8455-4cd9-95ee-1f9f2feb5541]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f131cbec-d557-4cac-b0ce-cbf80b36b5d8 tempest-SnapshotDependencyTests-1219387437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:10 devstack sudo[89929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d Feb 27 12:35:10 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:10 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ab19dadd-d9db-4a54-9b0e-fb060af27c8d tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f.dd47e25e-f76e-4994-9461-7f849a1a61dd" returned: 0 in 0.402s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ab19dadd-d9db-4a54-9b0e-fb060af27c8d tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:10 devstack sudo[89932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f.info Feb 27 12:35:10 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:11 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f131cbec-d557-4cac-b0ce-cbf80b36b5d8 tempest-SnapshotDependencyTests-1219387437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d" returned: 0 in 0.454s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f131cbec-d557-4cac-b0ce-cbf80b36b5d8 tempest-SnapshotDependencyTests-1219387437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:11 devstack sudo[89938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d Feb 27 12:35:11 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:11 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ab19dadd-d9db-4a54-9b0e-fb060af27c8d tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f.info" returned: 0 in 0.429s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:11 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-ab19dadd-d9db-4a54-9b0e-fb060af27c8d tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f.info is being set with open permissions: ugo+rw Feb 27 12:35:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ab19dadd-d9db-4a54-9b0e-fb060af27c8d tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:11 devstack sudo[89944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f.info Feb 27 12:35:11 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:11 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f131cbec-d557-4cac-b0ce-cbf80b36b5d8 tempest-SnapshotDependencyTests-1219387437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-12908f43-5ca5-4ff6-b942-9325e1cbb29d" returned: 0 in 0.420s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:11 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f131cbec-d557-4cac-b0ce-cbf80b36b5d8 tempest-SnapshotDependencyTests-1219387437 None] Lock "cinder-quobyte-12908f43-5ca5-4ff6-b942-9325e1cbb29d" released by "delete_volume" :: held 0.905s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:11 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-f131cbec-d557-4cac-b0ce-cbf80b36b5d8 tempest-SnapshotDependencyTests-1219387437 None] Created reservations ['0f33aa0e-8f0a-47ca-a069-c34d2cd8059f', '9ab60bb2-8307-4521-bcaa-97acb46df8af', '9b1d5719-0957-4fb9-9d51-fae2697833ed', '7d4632a0-5b55-4cbf-aa79-0995746ba319'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:35:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f131cbec-d557-4cac-b0ce-cbf80b36b5d8 tempest-SnapshotDependencyTests-1219387437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f131cbec-d557-4cac-b0ce-cbf80b36b5d8 tempest-SnapshotDependencyTests-1219387437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:11 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f131cbec-d557-4cac-b0ce-cbf80b36b5d8 tempest-SnapshotDependencyTests-1219387437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:11 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f131cbec-d557-4cac-b0ce-cbf80b36b5d8 tempest-SnapshotDependencyTests-1219387437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f131cbec-d557-4cac-b0ce-cbf80b36b5d8 tempest-SnapshotDependencyTests-1219387437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f131cbec-d557-4cac-b0ce-cbf80b36b5d8 tempest-SnapshotDependencyTests-1219387437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:11 devstack sudo[89947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:35:11 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:11 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f748e5c2-b2e9-4497-884a-5507d87f4465 tempest-SnapshotDependencyTests-1219387437 None] Acquiring lock "cinder-d925111a-cfe8-4da8-8c6a-6e0417c97457-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:11 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-ab19dadd-d9db-4a54-9b0e-fb060af27c8d tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f.info" returned: 0 in 0.448s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-ab19dadd-d9db-4a54-9b0e-fb060af27c8d tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.732s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:11 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f748e5c2-b2e9-4497-884a-5507d87f4465 tempest-SnapshotDependencyTests-1219387437 None] Lock "cinder-d925111a-cfe8-4da8-8c6a-6e0417c97457-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:11 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-ab19dadd-d9db-4a54-9b0e-fb060af27c8d tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Create snapshot completed successfully Feb 27 12:35:11 devstack cinder-volume[83077]: DEBUG dbcounter [-] [83077] Writing DB stats cinder:SELECT=140,cinder:UPDATE=195,cinder:DELETE=16,cinder:INSERT=51 {{(pid=83077) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:35:11 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f748e5c2-b2e9-4497-884a-5507d87f4465 tempest-SnapshotDependencyTests-1219387437 None] Acquiring lock "cinder-quobyte-d925111a-cfe8-4da8-8c6a-6e0417c97457" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:11 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f748e5c2-b2e9-4497-884a-5507d87f4465 tempest-SnapshotDependencyTests-1219387437 None] Lock "cinder-quobyte-d925111a-cfe8-4da8-8c6a-6e0417c97457" acquired by "delete_volume" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:11 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[343c176a-a357-426a-8bc7-f26bbfb442c9]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f748e5c2-b2e9-4497-884a-5507d87f4465 tempest-SnapshotDependencyTests-1219387437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d925111a-cfe8-4da8-8c6a-6e0417c97457 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:11 devstack sudo[89950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d925111a-cfe8-4da8-8c6a-6e0417c97457 Feb 27 12:35:11 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:12 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f131cbec-d557-4cac-b0ce-cbf80b36b5d8 tempest-SnapshotDependencyTests-1219387437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.427s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-f131cbec-d557-4cac-b0ce-cbf80b36b5d8 tempest-SnapshotDependencyTests-1219387437 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:35:12 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-f131cbec-d557-4cac-b0ce-cbf80b36b5d8 tempest-SnapshotDependencyTests-1219387437 None] Deleted volume successfully. Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f131cbec-d557-4cac-b0ce-cbf80b36b5d8 tempest-SnapshotDependencyTests-1219387437 None] Lock "cinder-12908f43-5ca5-4ff6-b942-9325e1cbb29d-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-dca9f54e-123d-4f8b-a1fe-e0c82e6a9b99 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Acquiring lock "cinder-dd47e25e-f76e-4994-9461-7f849a1a61dd-delete_snapshot" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-dca9f54e-123d-4f8b-a1fe-e0c82e6a9b99 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Lock "cinder-dd47e25e-f76e-4994-9461-7f849a1a61dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-dca9f54e-123d-4f8b-a1fe-e0c82e6a9b99 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Acquiring lock "cinder-quobyte-77242436-9bbe-45c2-b5e5-6083c3a8fb3f" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-dca9f54e-123d-4f8b-a1fe-e0c82e6a9b99 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Lock "cinder-quobyte-77242436-9bbe-45c2-b5e5-6083c3a8fb3f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-dca9f54e-123d-4f8b-a1fe-e0c82e6a9b99 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Acquiring lock "cinder-quobyte-dd47e25e-f76e-4994-9461-7f849a1a61dd" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-dca9f54e-123d-4f8b-a1fe-e0c82e6a9b99 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Lock "cinder-quobyte-dd47e25e-f76e-4994-9461-7f849a1a61dd" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-dca9f54e-123d-4f8b-a1fe-e0c82e6a9b99 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Deleting offline snapshot dd47e25e-f76e-4994-9461-7f849a1a61dd of volume 77242436-9bbe-45c2-b5e5-6083c3a8fb3f {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-dca9f54e-123d-4f8b-a1fe-e0c82e6a9b99 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] snapshot_file for this snap is: volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f.dd47e25e-f76e-4994-9461-7f849a1a61dd {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9f95e1-6a53-4894-b37e-269ffdbcfe16]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dca9f54e-123d-4f8b-a1fe-e0c82e6a9b99 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f.dd47e25e-f76e-4994-9461-7f849a1a61dd {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:12 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:12 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f.dd47e25e-f76e-4994-9461-7f849a1a61dd Feb 27 12:35:12 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f748e5c2-b2e9-4497-884a-5507d87f4465 tempest-SnapshotDependencyTests-1219387437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d925111a-cfe8-4da8-8c6a-6e0417c97457" returned: 0 in 0.508s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f748e5c2-b2e9-4497-884a-5507d87f4465 tempest-SnapshotDependencyTests-1219387437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d925111a-cfe8-4da8-8c6a-6e0417c97457 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:12 devstack sudo[89958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d925111a-cfe8-4da8-8c6a-6e0417c97457 Feb 27 12:35:12 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:12 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dca9f54e-123d-4f8b-a1fe-e0c82e6a9b99 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f.dd47e25e-f76e-4994-9461-7f849a1a61dd" returned: 0 in 0.457s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-dca9f54e-123d-4f8b-a1fe-e0c82e6a9b99 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c732fb21-24a1-4a59-8743-9f5ba58e9874]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dca9f54e-123d-4f8b-a1fe-e0c82e6a9b99 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:12 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f748e5c2-b2e9-4497-884a-5507d87f4465 tempest-SnapshotDependencyTests-1219387437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-d925111a-cfe8-4da8-8c6a-6e0417c97457" returned: 0 in 0.464s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f748e5c2-b2e9-4497-884a-5507d87f4465 tempest-SnapshotDependencyTests-1219387437 None] Lock "cinder-quobyte-d925111a-cfe8-4da8-8c6a-6e0417c97457" released by "delete_volume" :: held 1.012s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-f748e5c2-b2e9-4497-884a-5507d87f4465 tempest-SnapshotDependencyTests-1219387437 None] Created reservations ['7c93a23b-d926-4aad-9db0-52e759713fad', '40d1e516-5369-4ea1-ac77-4445dea8a216', '8c88e642-59b8-457f-998c-54a0eb715557', '1715902a-6c27-43fd-acb3-23e65b8fe7bc'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:35:12 devstack sudo[89980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f Feb 27 12:35:12 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f748e5c2-b2e9-4497-884a-5507d87f4465 tempest-SnapshotDependencyTests-1219387437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f748e5c2-b2e9-4497-884a-5507d87f4465 tempest-SnapshotDependencyTests-1219387437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f748e5c2-b2e9-4497-884a-5507d87f4465 tempest-SnapshotDependencyTests-1219387437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f748e5c2-b2e9-4497-884a-5507d87f4465 tempest-SnapshotDependencyTests-1219387437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f748e5c2-b2e9-4497-884a-5507d87f4465 tempest-SnapshotDependencyTests-1219387437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f748e5c2-b2e9-4497-884a-5507d87f4465 tempest-SnapshotDependencyTests-1219387437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:12 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:35:12 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:13 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dca9f54e-123d-4f8b-a1fe-e0c82e6a9b99 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f" returned: 0 in 0.662s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dca9f54e-123d-4f8b-a1fe-e0c82e6a9b99 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f.dd47e25e-f76e-4994-9461-7f849a1a61dd {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:13 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f.dd47e25e-f76e-4994-9461-7f849a1a61dd Feb 27 12:35:13 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:13 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f748e5c2-b2e9-4497-884a-5507d87f4465 tempest-SnapshotDependencyTests-1219387437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.549s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:13 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-f748e5c2-b2e9-4497-884a-5507d87f4465 tempest-SnapshotDependencyTests-1219387437 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:35:13 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-f748e5c2-b2e9-4497-884a-5507d87f4465 tempest-SnapshotDependencyTests-1219387437 None] Deleted volume successfully. Feb 27 12:35:13 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f748e5c2-b2e9-4497-884a-5507d87f4465 tempest-SnapshotDependencyTests-1219387437 None] Lock "cinder-d925111a-cfe8-4da8-8c6a-6e0417c97457-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:13 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dca9f54e-123d-4f8b-a1fe-e0c82e6a9b99 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f.dd47e25e-f76e-4994-9461-7f849a1a61dd" returned: 0 in 0.504s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dca9f54e-123d-4f8b-a1fe-e0c82e6a9b99 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f.dd47e25e-f76e-4994-9461-7f849a1a61dd {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:13 devstack sudo[90004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f.dd47e25e-f76e-4994-9461-7f849a1a61dd Feb 27 12:35:13 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:14 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dca9f54e-123d-4f8b-a1fe-e0c82e6a9b99 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f.dd47e25e-f76e-4994-9461-7f849a1a61dd" returned: 0 in 0.411s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:14 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-dca9f54e-123d-4f8b-a1fe-e0c82e6a9b99 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Lock "cinder-quobyte-dd47e25e-f76e-4994-9461-7f849a1a61dd" released by "_delete_snapshot" :: held 2.112s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:14 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-dca9f54e-123d-4f8b-a1fe-e0c82e6a9b99 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Lock "cinder-quobyte-77242436-9bbe-45c2-b5e5-6083c3a8fb3f" released by "delete_snapshot" :: held 2.125s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:14 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-dca9f54e-123d-4f8b-a1fe-e0c82e6a9b99 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Created reservations ['3197cc75-af97-41e9-bb3c-6ee9414373bd', 'fad10145-0d0e-45cd-ae31-76e221302a25', '3ee978fd-742c-4e29-b78c-12979f224ccb', 'c04974b5-5a37-4db6-bc4c-574a1c5e4c11'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:35:14 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-dca9f54e-123d-4f8b-a1fe-e0c82e6a9b99 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Delete snapshot completed successfully. Feb 27 12:35:14 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-dca9f54e-123d-4f8b-a1fe-e0c82e6a9b99 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Lock "cinder-dd47e25e-f76e-4994-9461-7f849a1a61dd-delete_snapshot" released by "delete_snapshot" :: held 2.220s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4b3ad6d8-a09b-4065-907f-b41175a9d941 tempest-VolumesActionsTest-1655305945 None] Acquiring lock "cinder-643444f7-efc6-47d5-ac82-a47d1ee160c2" by "attach_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4b3ad6d8-a09b-4065-907f-b41175a9d941 tempest-VolumesActionsTest-1655305945 None] Lock "cinder-643444f7-efc6-47d5-ac82-a47d1ee160c2" acquired by "attach_volume" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:15 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-4b3ad6d8-a09b-4065-907f-b41175a9d941 tempest-VolumesActionsTest-1655305945 None] Attaching volume 643444f7-efc6-47d5-ac82-a47d1ee160c2 to instance db962632-2ebb-4322-a0a0-fdabcba0a4b4 at mountpoint /dev/vdb on host None. Feb 27 12:35:15 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-4b3ad6d8-a09b-4065-907f-b41175a9d941 tempest-VolumesActionsTest-1655305945 None] Attach volume completed successfully. Feb 27 12:35:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4b3ad6d8-a09b-4065-907f-b41175a9d941 tempest-VolumesActionsTest-1655305945 None] Lock "cinder-643444f7-efc6-47d5-ac82-a47d1ee160c2" released by "attach_volume" :: held 0.063s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-825c713f-3be8-4da2-bac0-cc5daa280143 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Acquiring lock "cinder-77242436-9bbe-45c2-b5e5-6083c3a8fb3f-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-825c713f-3be8-4da2-bac0-cc5daa280143 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Lock "cinder-77242436-9bbe-45c2-b5e5-6083c3a8fb3f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-825c713f-3be8-4da2-bac0-cc5daa280143 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Acquiring lock "cinder-quobyte-77242436-9bbe-45c2-b5e5-6083c3a8fb3f" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-825c713f-3be8-4da2-bac0-cc5daa280143 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Lock "cinder-quobyte-77242436-9bbe-45c2-b5e5-6083c3a8fb3f" acquired by "delete_volume" :: waited 0.007s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:15 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da6429f-a89e-41de-8d5d-1c0d9336d3ff]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-825c713f-3be8-4da2-bac0-cc5daa280143 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:15 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f Feb 27 12:35:15 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-01477371-e4b1-441f-8df3-543d405d9d72 tempest-VolumesActionsTest-1655305945 None] Acquiring lock "cinder-643444f7-efc6-47d5-ac82-a47d1ee160c2-detach_volume" by "detach_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-01477371-e4b1-441f-8df3-543d405d9d72 tempest-VolumesActionsTest-1655305945 None] Lock "cinder-643444f7-efc6-47d5-ac82-a47d1ee160c2-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:15 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-01477371-e4b1-441f-8df3-543d405d9d72 tempest-VolumesActionsTest-1655305945 None] Detaching volume 643444f7-efc6-47d5-ac82-a47d1ee160c2 from instance db962632-2ebb-4322-a0a0-fdabcba0a4b4. Feb 27 12:35:15 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-01477371-e4b1-441f-8df3-543d405d9d72 tempest-VolumesActionsTest-1655305945 None] Detach volume completed successfully. Feb 27 12:35:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-01477371-e4b1-441f-8df3-543d405d9d72 tempest-VolumesActionsTest-1655305945 None] Lock "cinder-643444f7-efc6-47d5-ac82-a47d1ee160c2-detach_volume" released by "detach_volume" :: held 0.037s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:16 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-825c713f-3be8-4da2-bac0-cc5daa280143 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f" returned: 0 in 0.617s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-825c713f-3be8-4da2-bac0-cc5daa280143 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:16 devstack sudo[90013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f Feb 27 12:35:16 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:16 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-825c713f-3be8-4da2-bac0-cc5daa280143 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-77242436-9bbe-45c2-b5e5-6083c3a8fb3f" returned: 0 in 0.571s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:16 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-825c713f-3be8-4da2-bac0-cc5daa280143 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Lock "cinder-quobyte-77242436-9bbe-45c2-b5e5-6083c3a8fb3f" released by "delete_volume" :: held 1.245s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:16 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-825c713f-3be8-4da2-bac0-cc5daa280143 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Created reservations ['86c4bc48-3fa6-4bd7-ae94-891036811eb1', 'a90e94ad-179c-492c-9b41-7e8216928fd5', '0c085c02-15a3-4215-8872-fcd80526f481', '5ba21208-d38c-4130-af30-f56e1f0537e2'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:35:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-825c713f-3be8-4da2-bac0-cc5daa280143 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-825c713f-3be8-4da2-bac0-cc5daa280143 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-825c713f-3be8-4da2-bac0-cc5daa280143 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-825c713f-3be8-4da2-bac0-cc5daa280143 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-825c713f-3be8-4da2-bac0-cc5daa280143 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-825c713f-3be8-4da2-bac0-cc5daa280143 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:16 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:35:16 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:17 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-825c713f-3be8-4da2-bac0-cc5daa280143 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.535s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:17 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-825c713f-3be8-4da2-bac0-cc5daa280143 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:35:17 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-825c713f-3be8-4da2-bac0-cc5daa280143 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Deleted volume successfully. Feb 27 12:35:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-825c713f-3be8-4da2-bac0-cc5daa280143 tempest-VolumesSnapshotNegativeTestJSON-2002404824 None] Lock "cinder-77242436-9bbe-45c2-b5e5-6083c3a8fb3f-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:25 devstack cinder-volume[83077]: DEBUG dbcounter [-] [83077] Writing DB stats cinder:SELECT=160,cinder:INSERT=56,cinder:UPDATE=174,cinder:DELETE=18 {{(pid=83077) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:35:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-029cf7ce-9b5a-462f-b96c-2974f2d53cf6 tempest-VolumesActionsTest-1655305945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-029cf7ce-9b5a-462f-b96c-2974f2d53cf6 tempest-VolumesActionsTest-1655305945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:25 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7e4278-dbed-48b9-9569-64267aeddc57]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-029cf7ce-9b5a-462f-b96c-2974f2d53cf6 tempest-VolumesActionsTest-1655305945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:25 devstack sudo[90052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 Feb 27 12:35:25 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:25 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-029cf7ce-9b5a-462f-b96c-2974f2d53cf6 tempest-VolumesActionsTest-1655305945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2" returned: 0 in 0.439s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:25 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[12df3ce9-1b0f-4e7b-a316-4d3be19aa944]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-029cf7ce-9b5a-462f-b96c-2974f2d53cf6 tempest-VolumesActionsTest-1655305945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:25 devstack sudo[90057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 Feb 27 12:35:25 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:26 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-029cf7ce-9b5a-462f-b96c-2974f2d53cf6 tempest-VolumesActionsTest-1655305945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2" returned: 0 in 0.444s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-029cf7ce-9b5a-462f-b96c-2974f2d53cf6 tempest-VolumesActionsTest-1655305945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 /opt/stack/data/cinder/conversion/643444f7-efc6-47d5-ac82-a47d1ee160c2.temp_image.ac58e064-f7a6-4772-9608-3dbd0d80a30a4xg7r0uf.img {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:26 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 /opt/stack/data/cinder/conversion/643444f7-efc6-47d5-ac82-a47d1ee160c2.temp_image.ac58e064-f7a6-4772-9608-3dbd0d80a30a4xg7r0uf.img Feb 27 12:35:26 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:26 devstack cinder-volume[83077]: DEBUG dbcounter [-] [83077] Writing DB stats cinder:DELETE=1,cinder:SELECT=24,cinder:INSERT=5,cinder:UPDATE=29 {{(pid=83077) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:35:27 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-029cf7ce-9b5a-462f-b96c-2974f2d53cf6 tempest-VolumesActionsTest-1655305945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 /opt/stack/data/cinder/conversion/643444f7-efc6-47d5-ac82-a47d1ee160c2.temp_image.ac58e064-f7a6-4772-9608-3dbd0d80a30a4xg7r0uf.img" returned: 0 in 1.704s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:27 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[b357becd-4e00-4f86-96de-43dc5906ca85]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-029cf7ce-9b5a-462f-b96c-2974f2d53cf6 tempest-VolumesActionsTest-1655305945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:27 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 Feb 27 12:35:27 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:28 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-029cf7ce-9b5a-462f-b96c-2974f2d53cf6 tempest-VolumesActionsTest-1655305945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2" returned: 0 in 0.551s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:28 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-029cf7ce-9b5a-462f-b96c-2974f2d53cf6 tempest-VolumesActionsTest-1655305945 None] Image conversion details: src /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2, size 1024.00 MB, duration 1.70 sec, destination /opt/stack/data/cinder/conversion/643444f7-efc6-47d5-ac82-a47d1ee160c2.temp_image.ac58e064-f7a6-4772-9608-3dbd0d80a30a4xg7r0uf.img {{(pid=83077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:35:28 devstack cinder-volume[83077]: INFO cinder.image.image_utils [None req-029cf7ce-9b5a-462f-b96c-2974f2d53cf6 tempest-VolumesActionsTest-1655305945 None] Converted 1024.00 MB image at 600.76 MB/s Feb 27 12:35:28 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-029cf7ce-9b5a-462f-b96c-2974f2d53cf6 tempest-VolumesActionsTest-1655305945 None] ac58e064-f7a6-4772-9608-3dbd0d80a30a was raw, no need to convert to raw {{(pid=83077) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Feb 27 12:35:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-029cf7ce-9b5a-462f-b96c-2974f2d53cf6 tempest-VolumesActionsTest-1655305945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.008s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-029cf7ce-9b5a-462f-b96c-2974f2d53cf6 tempest-VolumesActionsTest-1655305945 None] Uploaded volume to glance image-id: ac58e064-f7a6-4772-9608-3dbd0d80a30a. {{(pid=83077) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Feb 27 12:35:38 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-029cf7ce-9b5a-462f-b96c-2974f2d53cf6 tempest-VolumesActionsTest-1655305945 None] Copy volume to image completed successfully. Feb 27 12:35:38 devstack cinder-volume[83077]: DEBUG dbcounter [-] [83077] Writing DB stats cinder:SELECT=2 {{(pid=83077) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:35:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2b1a2fba-96e4-4a5c-a555-f2c228421fdf tempest-VolumesActionsTest-1655305945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2b1a2fba-96e4-4a5c-a555-f2c228421fdf tempest-VolumesActionsTest-1655305945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:38 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[69feaa22-ff3b-43ab-a6de-3b1d690350f4]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2b1a2fba-96e4-4a5c-a555-f2c228421fdf tempest-VolumesActionsTest-1655305945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:39 devstack sudo[90120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 Feb 27 12:35:39 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:39 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2b1a2fba-96e4-4a5c-a555-f2c228421fdf tempest-VolumesActionsTest-1655305945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2" returned: 0 in 0.439s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:39 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[6511824a-ca0c-4511-ac16-753ffc502426]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2b1a2fba-96e4-4a5c-a555-f2c228421fdf tempest-VolumesActionsTest-1655305945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:39 devstack sudo[90125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 Feb 27 12:35:39 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:39 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2b1a2fba-96e4-4a5c-a555-f2c228421fdf tempest-VolumesActionsTest-1655305945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2" returned: 0 in 0.433s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2b1a2fba-96e4-4a5c-a555-f2c228421fdf tempest-VolumesActionsTest-1655305945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 /opt/stack/data/cinder/conversion/643444f7-efc6-47d5-ac82-a47d1ee160c2.temp_image.c52894a0-03a9-4e79-9dcd-6c734ca7ff33fw_g_am3.img {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:39 devstack sudo[90130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 /opt/stack/data/cinder/conversion/643444f7-efc6-47d5-ac82-a47d1ee160c2.temp_image.c52894a0-03a9-4e79-9dcd-6c734ca7ff33fw_g_am3.img Feb 27 12:35:39 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:41 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2b1a2fba-96e4-4a5c-a555-f2c228421fdf tempest-VolumesActionsTest-1655305945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 /opt/stack/data/cinder/conversion/643444f7-efc6-47d5-ac82-a47d1ee160c2.temp_image.c52894a0-03a9-4e79-9dcd-6c734ca7ff33fw_g_am3.img" returned: 0 in 1.657s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:41 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[86212217-53aa-4321-adf1-f7ccaab16a8e]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2b1a2fba-96e4-4a5c-a555-f2c228421fdf tempest-VolumesActionsTest-1655305945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:41 devstack sudo[90145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 Feb 27 12:35:41 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:42 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2b1a2fba-96e4-4a5c-a555-f2c228421fdf tempest-VolumesActionsTest-1655305945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2" returned: 0 in 0.563s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:42 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-2b1a2fba-96e4-4a5c-a555-f2c228421fdf tempest-VolumesActionsTest-1655305945 None] Image conversion details: src /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2, size 1024.00 MB, duration 1.66 sec, destination /opt/stack/data/cinder/conversion/643444f7-efc6-47d5-ac82-a47d1ee160c2.temp_image.c52894a0-03a9-4e79-9dcd-6c734ca7ff33fw_g_am3.img {{(pid=83077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:35:42 devstack cinder-volume[83077]: INFO cinder.image.image_utils [None req-2b1a2fba-96e4-4a5c-a555-f2c228421fdf tempest-VolumesActionsTest-1655305945 None] Converted 1024.00 MB image at 617.56 MB/s Feb 27 12:35:42 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-2b1a2fba-96e4-4a5c-a555-f2c228421fdf tempest-VolumesActionsTest-1655305945 None] c52894a0-03a9-4e79-9dcd-6c734ca7ff33 was raw, converting to qcow2 {{(pid=83077) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Feb 27 12:35:42 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3ed088-d7d3-4f92-ac6c-3932803d57b2]: (4, 'raw') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2b1a2fba-96e4-4a5c-a555-f2c228421fdf tempest-VolumesActionsTest-1655305945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/643444f7-efc6-47d5-ac82-a47d1ee160c2.temp_image.c52894a0-03a9-4e79-9dcd-6c734ca7ff33fw_g_am3.img {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:42 devstack sudo[90150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/643444f7-efc6-47d5-ac82-a47d1ee160c2.temp_image.c52894a0-03a9-4e79-9dcd-6c734ca7ff33fw_g_am3.img Feb 27 12:35:42 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:42 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2b1a2fba-96e4-4a5c-a555-f2c228421fdf tempest-VolumesActionsTest-1655305945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/643444f7-efc6-47d5-ac82-a47d1ee160c2.temp_image.c52894a0-03a9-4e79-9dcd-6c734ca7ff33fw_g_am3.img" returned: 0 in 0.431s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2b1a2fba-96e4-4a5c-a555-f2c228421fdf tempest-VolumesActionsTest-1655305945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/643444f7-efc6-47d5-ac82-a47d1ee160c2.temp_image.c52894a0-03a9-4e79-9dcd-6c734ca7ff33fw_g_am3.img {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:42 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/643444f7-efc6-47d5-ac82-a47d1ee160c2.temp_image.c52894a0-03a9-4e79-9dcd-6c734ca7ff33fw_g_am3.img Feb 27 12:35:42 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:42 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2b1a2fba-96e4-4a5c-a555-f2c228421fdf tempest-VolumesActionsTest-1655305945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/643444f7-efc6-47d5-ac82-a47d1ee160c2.temp_image.c52894a0-03a9-4e79-9dcd-6c734ca7ff33fw_g_am3.img" returned: 1 in 0.432s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2b1a2fba-96e4-4a5c-a555-f2c228421fdf tempest-VolumesActionsTest-1655305945 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/643444f7-efc6-47d5-ac82-a47d1ee160c2.temp_image.c52894a0-03a9-4e79-9dcd-6c734ca7ff33fw_g_am3.img' failed. Not Retrying. {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:35:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2b1a2fba-96e4-4a5c-a555-f2c228421fdf tempest-VolumesActionsTest-1655305945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/643444f7-efc6-47d5-ac82-a47d1ee160c2.temp_image.c52894a0-03a9-4e79-9dcd-6c734ca7ff33fw_g_am3.img /opt/stack/data/cinder/conversion/vol_upload_jfk5i1np {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:42 devstack sudo[90160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/643444f7-efc6-47d5-ac82-a47d1ee160c2.temp_image.c52894a0-03a9-4e79-9dcd-6c734ca7ff33fw_g_am3.img /opt/stack/data/cinder/conversion/vol_upload_jfk5i1np Feb 27 12:35:42 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:43 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2b1a2fba-96e4-4a5c-a555-f2c228421fdf tempest-VolumesActionsTest-1655305945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/643444f7-efc6-47d5-ac82-a47d1ee160c2.temp_image.c52894a0-03a9-4e79-9dcd-6c734ca7ff33fw_g_am3.img /opt/stack/data/cinder/conversion/vol_upload_jfk5i1np" returned: 0 in 0.420s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:43 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-2b1a2fba-96e4-4a5c-a555-f2c228421fdf tempest-VolumesActionsTest-1655305945 None] Image conversion details: src /opt/stack/data/cinder/conversion/643444f7-efc6-47d5-ac82-a47d1ee160c2.temp_image.c52894a0-03a9-4e79-9dcd-6c734ca7ff33fw_g_am3.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_jfk5i1np {{(pid=83077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:35:43 devstack cinder-volume[83077]: INFO cinder.image.image_utils [None req-2b1a2fba-96e4-4a5c-a555-f2c228421fdf tempest-VolumesActionsTest-1655305945 None] Converted 1024.00 MB image at 1024.00 MB/s Feb 27 12:35:43 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb6e0c5-8115-4e76-9c88-4c62651ba070]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2b1a2fba-96e4-4a5c-a555-f2c228421fdf tempest-VolumesActionsTest-1655305945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jfk5i1np {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:43 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jfk5i1np Feb 27 12:35:43 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:43 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2b1a2fba-96e4-4a5c-a555-f2c228421fdf tempest-VolumesActionsTest-1655305945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jfk5i1np" returned: 0 in 0.442s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2b1a2fba-96e4-4a5c-a555-f2c228421fdf tempest-VolumesActionsTest-1655305945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 5.623s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2b1a2fba-96e4-4a5c-a555-f2c228421fdf tempest-VolumesActionsTest-1655305945 None] Uploaded volume to glance image-id: c52894a0-03a9-4e79-9dcd-6c734ca7ff33. {{(pid=83077) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Feb 27 12:35:44 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-2b1a2fba-96e4-4a5c-a555-f2c228421fdf tempest-VolumesActionsTest-1655305945 None] Copy volume to image completed successfully. Feb 27 12:35:45 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-43483903-8757-448c-81d5-beecce8d6ecc tempest-VolumesActionsTest-1655305945 None] Acquiring lock "cinder-643444f7-efc6-47d5-ac82-a47d1ee160c2-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:45 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-43483903-8757-448c-81d5-beecce8d6ecc tempest-VolumesActionsTest-1655305945 None] Lock "cinder-643444f7-efc6-47d5-ac82-a47d1ee160c2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:45 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-43483903-8757-448c-81d5-beecce8d6ecc tempest-VolumesActionsTest-1655305945 None] Acquiring lock "cinder-quobyte-643444f7-efc6-47d5-ac82-a47d1ee160c2" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:45 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-43483903-8757-448c-81d5-beecce8d6ecc tempest-VolumesActionsTest-1655305945 None] Lock "cinder-quobyte-643444f7-efc6-47d5-ac82-a47d1ee160c2" acquired by "delete_volume" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:45 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fbad31-b91e-4840-ac38-40c50a981724]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-43483903-8757-448c-81d5-beecce8d6ecc tempest-VolumesActionsTest-1655305945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:45 devstack sudo[90170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 Feb 27 12:35:45 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:46 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-43483903-8757-448c-81d5-beecce8d6ecc tempest-VolumesActionsTest-1655305945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2" returned: 0 in 0.442s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-43483903-8757-448c-81d5-beecce8d6ecc tempest-VolumesActionsTest-1655305945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:46 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2 Feb 27 12:35:46 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:46 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-43483903-8757-448c-81d5-beecce8d6ecc tempest-VolumesActionsTest-1655305945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-643444f7-efc6-47d5-ac82-a47d1ee160c2" returned: 0 in 0.391s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:46 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-43483903-8757-448c-81d5-beecce8d6ecc tempest-VolumesActionsTest-1655305945 None] Lock "cinder-quobyte-643444f7-efc6-47d5-ac82-a47d1ee160c2" released by "delete_volume" :: held 0.858s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:46 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-43483903-8757-448c-81d5-beecce8d6ecc tempest-VolumesActionsTest-1655305945 None] Created reservations ['be216b88-04f7-417d-bd8c-423df8312525', '968c7b0c-9f32-44be-9a47-bb0f208098e3', '29b35876-e587-4bdc-ae72-f4bddb5395d2', '64da4334-47d2-4e72-bcd7-cda8c99b88f0'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:35:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-43483903-8757-448c-81d5-beecce8d6ecc tempest-VolumesActionsTest-1655305945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-43483903-8757-448c-81d5-beecce8d6ecc tempest-VolumesActionsTest-1655305945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:46 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-43483903-8757-448c-81d5-beecce8d6ecc tempest-VolumesActionsTest-1655305945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:46 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-43483903-8757-448c-81d5-beecce8d6ecc tempest-VolumesActionsTest-1655305945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-43483903-8757-448c-81d5-beecce8d6ecc tempest-VolumesActionsTest-1655305945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-43483903-8757-448c-81d5-beecce8d6ecc tempest-VolumesActionsTest-1655305945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:46 devstack sudo[90178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:35:46 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:46 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-43483903-8757-448c-81d5-beecce8d6ecc tempest-VolumesActionsTest-1655305945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.433s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:46 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-43483903-8757-448c-81d5-beecce8d6ecc tempest-VolumesActionsTest-1655305945 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:35:46 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-43483903-8757-448c-81d5-beecce8d6ecc tempest-VolumesActionsTest-1655305945 None] Deleted volume successfully. Feb 27 12:35:46 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-43483903-8757-448c-81d5-beecce8d6ecc tempest-VolumesActionsTest-1655305945 None] Lock "cinder-643444f7-efc6-47d5-ac82-a47d1ee160c2-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:50 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:35:50 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Flow 'volume_create_manager' (c5931545-8083-48d6-bf04-bb7e4c56718d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:35:50 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f9daf7-1d99-4ea2-a74d-9c25e3977490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:50 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f9daf7-1d99-4ea2-a74d-9c25e3977490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-93603400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22c8abef-8e01-4148-9349-96e77088600b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247bc70795fc4b6eb1453e9d12a0b02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:35:50Z,use_quota=True,user_id='8670db6a602c40fcbd56d960652135ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:50 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b40db6f5-0723-4180-b3da-33fc3c2fb946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:50 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b40db6f5-0723-4180-b3da-33fc3c2fb946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:50 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d94675-b507-415c-b270-98f81babe674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:50 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d94675-b507-415c-b270-98f81babe674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22c8abef-8e01-4148-9349-96e77088600b', 'volume_name': 'volume-22c8abef-8e01-4148-9349-96e77088600b', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:50 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7362e7-baab-4d8f-ac3e-538d857d222c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:50 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7362e7-baab-4d8f-ac3e-538d857d222c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:50 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5fd8d9c-2106-49cb-8c88-3bcc337cb084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:50 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Volume 22c8abef-8e01-4148-9349-96e77088600b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22c8abef-8e01-4148-9349-96e77088600b', 'volume_size': 1} Feb 27 12:35:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:50 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-93603400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22c8abef-8e01-4148-9349-96e77088600b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247bc70795fc4b6eb1453e9d12a0b02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:35:50Z,use_quota=True,user_id='8670db6a602c40fcbd56d960652135ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:35:50 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Creating volume 22c8abef-8e01-4148-9349-96e77088600b {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:35:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:50 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:50 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:50 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:35:50 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:35:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:50 devstack sudo[90184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b 1073741824 Feb 27 12:35:50 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:50 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b 1073741824" returned: 0 in 0.460s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:50 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b Feb 27 12:35:50 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:51 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b" returned: 0 in 0.403s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:51 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:35:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5fd8d9c-2106-49cb-8c88-3bcc337cb084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22c8abef-8e01-4148-9349-96e77088600b', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f4c532-27a6-45b5-b162-441d336f408b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:51 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Volume volume-22c8abef-8e01-4148-9349-96e77088600b (22c8abef-8e01-4148-9349-96e77088600b): created successfully Feb 27 12:35:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f4c532-27a6-45b5-b162-441d336f408b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Flow 'volume_create_manager' (c5931545-8083-48d6-bf04-bb7e4c56718d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:35:51 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-bd72e0ec-e980-4bd1-b977-a60266d31770 tempest-VolumesCloneTest-1186319876 None] Created volume successfully. Feb 27 12:35:51 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:35:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Flow 'volume_create_manager' (ce95d871-a387-4e1e-9d48-15cc4a9bec36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:35:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be128b3d-fc37-47e0-a4e7-14395be64180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be128b3d-fc37-47e0-a4e7-14395be64180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1278294911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=badae783-fc56-42a0-baa8-812e2d399b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247bc70795fc4b6eb1453e9d12a0b02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:35:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=22c8abef-8e01-4148-9349-96e77088600b,status='creating',terminated_at=None,updated_at=2026-02-27T11:35:52Z,use_quota=True,user_id='8670db6a602c40fcbd56d960652135ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51b54f7-b264-4502-a610-d7ac2bf59f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51b54f7-b264-4502-a610-d7ac2bf59f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d2c75e-e9a2-4d59-a029-7b4872c794b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d2c75e-e9a2-4d59-a029-7b4872c794b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'badae783-fc56-42a0-baa8-812e2d399b49', 'volume_name': 'volume-badae783-fc56-42a0-baa8-812e2d399b49', 'volume_size': 2, 'source_volid': '22c8abef-8e01-4148-9349-96e77088600b', 'source_volstatus': 'available'}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b488a37-28f9-4bea-96e1-e913755a14d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b488a37-28f9-4bea-96e1-e913755a14d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:51 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381e272c-8539-4b50-8fa8-90c1cfff4724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:51 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Volume badae783-fc56-42a0-baa8-812e2d399b49: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-badae783-fc56-42a0-baa8-812e2d399b49', 'volume_size': 2, 'source_volid': '22c8abef-8e01-4148-9349-96e77088600b', 'source_volstatus': 'available'} Feb 27 12:35:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:51 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Cloning volume 22c8abef-8e01-4148-9349-96e77088600b to volume badae783-fc56-42a0-baa8-812e2d399b49 Feb 27 12:35:51 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Creating offline snapshot 100ffe16-63f6-4312-b7db-4f78ecc79fd6 of volume 22c8abef-8e01-4148-9349-96e77088600b {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:35:51 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaea7f46-22e5-4a40-b751-6c38e55d793c]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:51 devstack sudo[90193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b Feb 27 12:35:51 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:52 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b" returned: 0 in 0.463s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.100ffe16-63f6-4312-b7db-4f78ecc79fd6 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:52 devstack sudo[90198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.100ffe16-63f6-4312-b7db-4f78ecc79fd6 1G Feb 27 12:35:52 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:52 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.100ffe16-63f6-4312-b7db-4f78ecc79fd6 1G" returned: 0 in 0.468s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22c8abef-8e01-4148-9349-96e77088600b -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.100ffe16-63f6-4312-b7db-4f78ecc79fd6 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:52 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22c8abef-8e01-4148-9349-96e77088600b -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.100ffe16-63f6-4312-b7db-4f78ecc79fd6 Feb 27 12:35:52 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:53 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22c8abef-8e01-4148-9349-96e77088600b -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.100ffe16-63f6-4312-b7db-4f78ecc79fd6" returned: 0 in 0.414s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:53 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.100ffe16-63f6-4312-b7db-4f78ecc79fd6 is being set with open permissions: ugo+rw Feb 27 12:35:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.100ffe16-63f6-4312-b7db-4f78ecc79fd6 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:53 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.100ffe16-63f6-4312-b7db-4f78ecc79fd6 Feb 27 12:35:53 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:53 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.100ffe16-63f6-4312-b7db-4f78ecc79fd6" returned: 0 in 0.384s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:53 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.info Feb 27 12:35:53 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:53 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.info" returned: 0 in 0.397s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:53 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.info is being set with open permissions: ugo+rw Feb 27 12:35:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:53 devstack sudo[90214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.info Feb 27 12:35:53 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:54 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.info" returned: 0 in 0.387s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:54 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Acquiring lock "cinder-quobyte-badae783-fc56-42a0-baa8-812e2d399b49" by "_copy_volume_from_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:54 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Lock "cinder-quobyte-badae783-fc56-42a0-baa8-812e2d399b49" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:54 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] snapshot: 100ffe16-63f6-4312-b7db-4f78ecc79fd6, volume: badae783-fc56-42a0-baa8-812e2d399b49, {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 12:35:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:54 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:54 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:54 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5260065-5390-40b6-9c92-0190cd4646c4]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.100ffe16-63f6-4312-b7db-4f78ecc79fd6 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:54 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.100ffe16-63f6-4312-b7db-4f78ecc79fd6 Feb 27 12:35:54 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:54 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.100ffe16-63f6-4312-b7db-4f78ecc79fd6" returned: 0 in 0.443s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:54 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22c8abef-8e01-4148-9349-96e77088600b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:35:54 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 12:35:54 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Creating direct copy from snapshot {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 12:35:54 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbeae890-04b2-4c95-8611-dfc3b98c2e48]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:54 devstack sudo[90222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b Feb 27 12:35:54 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:55 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b" returned: 0 in 0.431s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:55 devstack cinder-volume[83077]: DEBUG cinder.utils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Path /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-badae783-fc56-42a0-baa8-812e2d399b49 not found in is_blk_device check {{(pid=83077) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 12:35:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-badae783-fc56-42a0-baa8-812e2d399b49 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:55 devstack sudo[90227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-badae783-fc56-42a0-baa8-812e2d399b49 Feb 27 12:35:55 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:56 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-badae783-fc56-42a0-baa8-812e2d399b49" returned: 0 in 1.741s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:56 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e86366-fa8b-4c70-85c7-0c284a5b9d65]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:56 devstack sudo[90239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b Feb 27 12:35:56 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:57 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b" returned: 0 in 0.553s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:57 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Image conversion details: src /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b, size 1024.00 MB, duration 1.74 sec, destination /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-badae783-fc56-42a0-baa8-812e2d399b49 {{(pid=83077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:35:57 devstack cinder-volume[83077]: INFO cinder.image.image_utils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Converted 1024.00 MB image at 587.71 MB/s Feb 27 12:35:57 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-badae783-fc56-42a0-baa8-812e2d399b49 is being set with open permissions: ugo+rw Feb 27 12:35:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-badae783-fc56-42a0-baa8-812e2d399b49 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:57 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-badae783-fc56-42a0-baa8-812e2d399b49 Feb 27 12:35:57 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:57 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-badae783-fc56-42a0-baa8-812e2d399b49" returned: 0 in 0.367s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:57 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Lock "cinder-quobyte-badae783-fc56-42a0-baa8-812e2d399b49" released by "_copy_volume_from_snapshot" :: held 3.584s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:57 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Acquiring lock "cinder-quobyte-100ffe16-63f6-4312-b7db-4f78ecc79fd6" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:57 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Lock "cinder-quobyte-100ffe16-63f6-4312-b7db-4f78ecc79fd6" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Deleting offline snapshot 100ffe16-63f6-4312-b7db-4f78ecc79fd6 of volume 22c8abef-8e01-4148-9349-96e77088600b {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:35:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] snapshot_file for this snap is: volume-22c8abef-8e01-4148-9349-96e77088600b.100ffe16-63f6-4312-b7db-4f78ecc79fd6 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:35:57 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a5f363-cb38-433a-91cd-719c5df0301b]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.100ffe16-63f6-4312-b7db-4f78ecc79fd6 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:57 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.100ffe16-63f6-4312-b7db-4f78ecc79fd6 Feb 27 12:35:57 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:58 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.100ffe16-63f6-4312-b7db-4f78ecc79fd6" returned: 0 in 0.461s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22c8abef-8e01-4148-9349-96e77088600b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:35:58 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7797618-e8e5-47bf-a2c7-fd5ebb701464]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:58 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b Feb 27 12:35:58 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:58 devstack cinder-volume[83077]: DEBUG oslo_service.periodic_task [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83077) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 12:35:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:58 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:35:58 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:58 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b" returned: 0 in 0.440s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.100ffe16-63f6-4312-b7db-4f78ecc79fd6 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:58 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.100ffe16-63f6-4312-b7db-4f78ecc79fd6 Feb 27 12:35:58 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:58 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.384s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:58 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:35:59 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.100ffe16-63f6-4312-b7db-4f78ecc79fd6" returned: 0 in 0.430s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.100ffe16-63f6-4312-b7db-4f78ecc79fd6 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:59 devstack sudo[90265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.100ffe16-63f6-4312-b7db-4f78ecc79fd6 Feb 27 12:35:59 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:59 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b.100ffe16-63f6-4312-b7db-4f78ecc79fd6" returned: 0 in 0.370s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:59 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Lock "cinder-quobyte-100ffe16-63f6-4312-b7db-4f78ecc79fd6" released by "_delete_snapshot" :: held 1.742s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 7.945s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381e272c-8539-4b50-8fa8-90c1cfff4724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-badae783-fc56-42a0-baa8-812e2d399b49', 'volume_size': 2, 'source_volid': '22c8abef-8e01-4148-9349-96e77088600b', 'source_volstatus': 'available'}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (207500f5-6afd-42bf-b21f-67390b2f68ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:59 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Volume volume-badae783-fc56-42a0-baa8-812e2d399b49 (badae783-fc56-42a0-baa8-812e2d399b49): created successfully Feb 27 12:35:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (207500f5-6afd-42bf-b21f-67390b2f68ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Flow 'volume_create_manager' (ce95d871-a387-4e1e-9d48-15cc4a9bec36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:35:59 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-cee189bc-2de6-4530-aad8-5d0a7b31d708 tempest-VolumesCloneTest-1186319876 None] Created volume successfully. Feb 27 12:36:00 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-855755f5-ba75-40b0-9800-1103fb99c7fb tempest-VolumesCloneTest-1186319876 None] Acquiring lock "cinder-badae783-fc56-42a0-baa8-812e2d399b49-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:00 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-855755f5-ba75-40b0-9800-1103fb99c7fb tempest-VolumesCloneTest-1186319876 None] Lock "cinder-badae783-fc56-42a0-baa8-812e2d399b49-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:00 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-855755f5-ba75-40b0-9800-1103fb99c7fb tempest-VolumesCloneTest-1186319876 None] Acquiring lock "cinder-quobyte-badae783-fc56-42a0-baa8-812e2d399b49" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:00 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-855755f5-ba75-40b0-9800-1103fb99c7fb tempest-VolumesCloneTest-1186319876 None] Lock "cinder-quobyte-badae783-fc56-42a0-baa8-812e2d399b49" acquired by "delete_volume" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:00 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0a7738-33a3-41c0-9e57-3e8e01181594]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-855755f5-ba75-40b0-9800-1103fb99c7fb tempest-VolumesCloneTest-1186319876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-badae783-fc56-42a0-baa8-812e2d399b49 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:00 devstack sudo[90268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-badae783-fc56-42a0-baa8-812e2d399b49 Feb 27 12:36:00 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:00 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-855755f5-ba75-40b0-9800-1103fb99c7fb tempest-VolumesCloneTest-1186319876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-badae783-fc56-42a0-baa8-812e2d399b49" returned: 0 in 0.476s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-855755f5-ba75-40b0-9800-1103fb99c7fb tempest-VolumesCloneTest-1186319876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-badae783-fc56-42a0-baa8-812e2d399b49 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:00 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-badae783-fc56-42a0-baa8-812e2d399b49 Feb 27 12:36:00 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:01 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-855755f5-ba75-40b0-9800-1103fb99c7fb tempest-VolumesCloneTest-1186319876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-badae783-fc56-42a0-baa8-812e2d399b49" returned: 0 in 0.395s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:01 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-855755f5-ba75-40b0-9800-1103fb99c7fb tempest-VolumesCloneTest-1186319876 None] Lock "cinder-quobyte-badae783-fc56-42a0-baa8-812e2d399b49" released by "delete_volume" :: held 0.896s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:01 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-855755f5-ba75-40b0-9800-1103fb99c7fb tempest-VolumesCloneTest-1186319876 None] Created reservations ['7aeb7892-be70-4e77-8327-70f98366f18d', '5a10d284-1aae-41f4-85c7-37a2894bd6f7', 'd2f5bc47-47ec-49cd-a54f-4b02d7bb0dd8', 'a2e3225d-b487-4424-90aa-b4fb9aff6e81'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:36:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-855755f5-ba75-40b0-9800-1103fb99c7fb tempest-VolumesCloneTest-1186319876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-855755f5-ba75-40b0-9800-1103fb99c7fb tempest-VolumesCloneTest-1186319876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:01 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-855755f5-ba75-40b0-9800-1103fb99c7fb tempest-VolumesCloneTest-1186319876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:01 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-855755f5-ba75-40b0-9800-1103fb99c7fb tempest-VolumesCloneTest-1186319876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-855755f5-ba75-40b0-9800-1103fb99c7fb tempest-VolumesCloneTest-1186319876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-855755f5-ba75-40b0-9800-1103fb99c7fb tempest-VolumesCloneTest-1186319876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:01 devstack sudo[90277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:36:01 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:01 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-872e26e4-3fac-4c0b-a9d3-ecf09a23fd86 tempest-VolumesCloneTest-1186319876 None] Acquiring lock "cinder-22c8abef-8e01-4148-9349-96e77088600b-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:01 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-872e26e4-3fac-4c0b-a9d3-ecf09a23fd86 tempest-VolumesCloneTest-1186319876 None] Lock "cinder-22c8abef-8e01-4148-9349-96e77088600b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:01 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-872e26e4-3fac-4c0b-a9d3-ecf09a23fd86 tempest-VolumesCloneTest-1186319876 None] Acquiring lock "cinder-quobyte-22c8abef-8e01-4148-9349-96e77088600b" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:01 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-872e26e4-3fac-4c0b-a9d3-ecf09a23fd86 tempest-VolumesCloneTest-1186319876 None] Lock "cinder-quobyte-22c8abef-8e01-4148-9349-96e77088600b" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:01 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfeef3a-cc50-4d1b-9bb2-d14b51fc1443]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-872e26e4-3fac-4c0b-a9d3-ecf09a23fd86 tempest-VolumesCloneTest-1186319876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:01 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b Feb 27 12:36:01 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:01 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-855755f5-ba75-40b0-9800-1103fb99c7fb tempest-VolumesCloneTest-1186319876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.412s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:01 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-855755f5-ba75-40b0-9800-1103fb99c7fb tempest-VolumesCloneTest-1186319876 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:36:01 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-855755f5-ba75-40b0-9800-1103fb99c7fb tempest-VolumesCloneTest-1186319876 None] Deleted volume successfully. Feb 27 12:36:01 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-855755f5-ba75-40b0-9800-1103fb99c7fb tempest-VolumesCloneTest-1186319876 None] Lock "cinder-badae783-fc56-42a0-baa8-812e2d399b49-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:01 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-872e26e4-3fac-4c0b-a9d3-ecf09a23fd86 tempest-VolumesCloneTest-1186319876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b" returned: 0 in 0.500s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-872e26e4-3fac-4c0b-a9d3-ecf09a23fd86 tempest-VolumesCloneTest-1186319876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:01 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b Feb 27 12:36:01 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:02 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-872e26e4-3fac-4c0b-a9d3-ecf09a23fd86 tempest-VolumesCloneTest-1186319876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-22c8abef-8e01-4148-9349-96e77088600b" returned: 0 in 0.418s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:02 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-872e26e4-3fac-4c0b-a9d3-ecf09a23fd86 tempest-VolumesCloneTest-1186319876 None] Lock "cinder-quobyte-22c8abef-8e01-4148-9349-96e77088600b" released by "delete_volume" :: held 0.955s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:02 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-872e26e4-3fac-4c0b-a9d3-ecf09a23fd86 tempest-VolumesCloneTest-1186319876 None] Created reservations ['0b8503e4-c088-4c94-af02-276c1ddf41ec', '79a16a0d-5348-4f99-8cd2-03ca0dd22443', 'd71e40da-8121-4ae2-a06c-60e50f35a1dd', '53228d54-5822-41e3-bd3b-56eff2b427e2'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:36:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-872e26e4-3fac-4c0b-a9d3-ecf09a23fd86 tempest-VolumesCloneTest-1186319876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-872e26e4-3fac-4c0b-a9d3-ecf09a23fd86 tempest-VolumesCloneTest-1186319876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:02 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-872e26e4-3fac-4c0b-a9d3-ecf09a23fd86 tempest-VolumesCloneTest-1186319876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:02 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-872e26e4-3fac-4c0b-a9d3-ecf09a23fd86 tempest-VolumesCloneTest-1186319876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-872e26e4-3fac-4c0b-a9d3-ecf09a23fd86 tempest-VolumesCloneTest-1186319876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-872e26e4-3fac-4c0b-a9d3-ecf09a23fd86 tempest-VolumesCloneTest-1186319876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:02 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:36:02 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:02 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-872e26e4-3fac-4c0b-a9d3-ecf09a23fd86 tempest-VolumesCloneTest-1186319876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.459s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:02 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-872e26e4-3fac-4c0b-a9d3-ecf09a23fd86 tempest-VolumesCloneTest-1186319876 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:36:02 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-872e26e4-3fac-4c0b-a9d3-ecf09a23fd86 tempest-VolumesCloneTest-1186319876 None] Deleted volume successfully. Feb 27 12:36:02 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-872e26e4-3fac-4c0b-a9d3-ecf09a23fd86 tempest-VolumesCloneTest-1186319876 None] Lock "cinder-22c8abef-8e01-4148-9349-96e77088600b-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:04 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Flow 'volume_create_manager' (a9ce2caa-3f6e-424b-8192-e07947e5172a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63425738-c40f-4235-9125-4fabedba8484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63425738-c40f-4235-9125-4fabedba8484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1590621972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e975b2-824e-4da1-8cd7-5dfc96373401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='226f97a6942742918c6c052d0cac6f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:04Z,use_quota=True,user_id='f52f8c4f3de04d448f3d239fb85c8909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c063310-bc16-4c53-a88f-60cc7aef40a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c063310-bc16-4c53-a88f-60cc7aef40a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f4cf2e-2a35-46cb-9745-b2aec38d7cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f4cf2e-2a35-46cb-9745-b2aec38d7cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50e975b2-824e-4da1-8cd7-5dfc96373401', 'volume_name': 'volume-50e975b2-824e-4da1-8cd7-5dfc96373401', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb3f561-b12e-4d7d-bf3f-ca8a3497e57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb3f561-b12e-4d7d-bf3f-ca8a3497e57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32cd093b-6991-458f-bc37-c56e86aebe73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:04 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Volume 50e975b2-824e-4da1-8cd7-5dfc96373401: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50e975b2-824e-4da1-8cd7-5dfc96373401', 'volume_size': 1} Feb 27 12:36:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1590621972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e975b2-824e-4da1-8cd7-5dfc96373401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='226f97a6942742918c6c052d0cac6f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:04Z,use_quota=True,user_id='f52f8c4f3de04d448f3d239fb85c8909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:36:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Creating volume 50e975b2-824e-4da1-8cd7-5dfc96373401 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:36:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:36:04 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:36:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-50e975b2-824e-4da1-8cd7-5dfc96373401 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:04 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-50e975b2-824e-4da1-8cd7-5dfc96373401 1073741824 Feb 27 12:36:04 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:04 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-50e975b2-824e-4da1-8cd7-5dfc96373401 1073741824" returned: 0 in 0.473s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-50e975b2-824e-4da1-8cd7-5dfc96373401 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:04 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-50e975b2-824e-4da1-8cd7-5dfc96373401 Feb 27 12:36:04 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:05 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-50e975b2-824e-4da1-8cd7-5dfc96373401" returned: 0 in 0.381s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:05 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:36:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32cd093b-6991-458f-bc37-c56e86aebe73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50e975b2-824e-4da1-8cd7-5dfc96373401', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47242c1-0af8-4950-8414-7cbc834f3377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:05 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Volume volume-50e975b2-824e-4da1-8cd7-5dfc96373401 (50e975b2-824e-4da1-8cd7-5dfc96373401): created successfully Feb 27 12:36:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47242c1-0af8-4950-8414-7cbc834f3377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Flow 'volume_create_manager' (a9ce2caa-3f6e-424b-8192-e07947e5172a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:05 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-d3a9f96a-837d-45e6-b40f-aecc5f8b8918 tempest-VolumesNegativeTest-1100783824 None] Created volume successfully. Feb 27 12:36:15 devstack cinder-volume[83077]: DEBUG dbcounter [-] [83077] Writing DB stats cinder:SELECT=24,cinder:UPDATE=35,cinder:INSERT=5,cinder:DELETE=2 {{(pid=83077) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:36:15 devstack cinder-volume[83077]: DEBUG dbcounter [-] [83077] Writing DB stats cinder:SELECT=29,cinder:UPDATE=36,cinder:INSERT=12,cinder:DELETE=4 {{(pid=83077) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:36:30 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8281c5ab-9190-48bf-b287-6ba3e901236b tempest-VolumesNegativeTest-1100783824 None] Acquiring lock "cinder-50e975b2-824e-4da1-8cd7-5dfc96373401-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:30 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8281c5ab-9190-48bf-b287-6ba3e901236b tempest-VolumesNegativeTest-1100783824 None] Lock "cinder-50e975b2-824e-4da1-8cd7-5dfc96373401-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:30 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8281c5ab-9190-48bf-b287-6ba3e901236b tempest-VolumesNegativeTest-1100783824 None] Acquiring lock "cinder-quobyte-50e975b2-824e-4da1-8cd7-5dfc96373401" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:30 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8281c5ab-9190-48bf-b287-6ba3e901236b tempest-VolumesNegativeTest-1100783824 None] Lock "cinder-quobyte-50e975b2-824e-4da1-8cd7-5dfc96373401" acquired by "delete_volume" :: waited 0.007s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:30 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dbf94e-07b1-4723-af8c-16cf04f643a0]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8281c5ab-9190-48bf-b287-6ba3e901236b tempest-VolumesNegativeTest-1100783824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-50e975b2-824e-4da1-8cd7-5dfc96373401 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:30 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-50e975b2-824e-4da1-8cd7-5dfc96373401 Feb 27 12:36:30 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:30 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8281c5ab-9190-48bf-b287-6ba3e901236b tempest-VolumesNegativeTest-1100783824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-50e975b2-824e-4da1-8cd7-5dfc96373401" returned: 0 in 0.447s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8281c5ab-9190-48bf-b287-6ba3e901236b tempest-VolumesNegativeTest-1100783824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-50e975b2-824e-4da1-8cd7-5dfc96373401 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:30 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-50e975b2-824e-4da1-8cd7-5dfc96373401 Feb 27 12:36:30 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:31 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8281c5ab-9190-48bf-b287-6ba3e901236b tempest-VolumesNegativeTest-1100783824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-50e975b2-824e-4da1-8cd7-5dfc96373401" returned: 0 in 0.444s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8281c5ab-9190-48bf-b287-6ba3e901236b tempest-VolumesNegativeTest-1100783824 None] Lock "cinder-quobyte-50e975b2-824e-4da1-8cd7-5dfc96373401" released by "delete_volume" :: held 0.925s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:31 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-8281c5ab-9190-48bf-b287-6ba3e901236b tempest-VolumesNegativeTest-1100783824 None] Created reservations ['b75f95d1-5758-4820-a286-2017bb17af85', 'e6cbd3a8-3f19-401d-97e6-31a275e9bb6d', '1d943688-2922-4e42-be52-7d6e17b22b36', '8498f5f1-a624-4acc-b41d-95561d03be28'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:36:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8281c5ab-9190-48bf-b287-6ba3e901236b tempest-VolumesNegativeTest-1100783824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8281c5ab-9190-48bf-b287-6ba3e901236b tempest-VolumesNegativeTest-1100783824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:31 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8281c5ab-9190-48bf-b287-6ba3e901236b tempest-VolumesNegativeTest-1100783824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:31 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8281c5ab-9190-48bf-b287-6ba3e901236b tempest-VolumesNegativeTest-1100783824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8281c5ab-9190-48bf-b287-6ba3e901236b tempest-VolumesNegativeTest-1100783824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8281c5ab-9190-48bf-b287-6ba3e901236b tempest-VolumesNegativeTest-1100783824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:31 devstack sudo[90428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:36:31 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:31 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8281c5ab-9190-48bf-b287-6ba3e901236b tempest-VolumesNegativeTest-1100783824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.462s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:31 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-8281c5ab-9190-48bf-b287-6ba3e901236b tempest-VolumesNegativeTest-1100783824 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:36:31 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-8281c5ab-9190-48bf-b287-6ba3e901236b tempest-VolumesNegativeTest-1100783824 None] Deleted volume successfully. Feb 27 12:36:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-8281c5ab-9190-48bf-b287-6ba3e901236b tempest-VolumesNegativeTest-1100783824 None] Lock "cinder-50e975b2-824e-4da1-8cd7-5dfc96373401-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Flow 'volume_create_manager' (43bacec4-ff42-4f92-8335-794ff5899900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dded4e7e-a7e8-41b2-8e5e-ea5134360414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dded4e7e-a7e8-41b2-8e5e-ea5134360414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1567439802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dbdcd38-2d7a-4a06-8eac-e51c62e38067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d4990b860b4747be7eb280e4cbced9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:38Z,use_quota=True,user_id='722b2a83f0c94b8aa1b9d295a6ad696e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b75a122-910c-45d6-a846-0abab890508c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b75a122-910c-45d6-a846-0abab890508c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b58509-dd35-45c4-89fb-abdd3f00b047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b58509-dd35-45c4-89fb-abdd3f00b047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dbdcd38-2d7a-4a06-8eac-e51c62e38067', 'volume_name': 'volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b289c4-5927-4d4a-8aa7-3c674cd5219a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b289c4-5927-4d4a-8aa7-3c674cd5219a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c54afbc-9019-4bee-a8c2-cf84a6ec83bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:38 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Volume 1dbdcd38-2d7a-4a06-8eac-e51c62e38067: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067', 'volume_size': 1} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1567439802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dbdcd38-2d7a-4a06-8eac-e51c62e38067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d4990b860b4747be7eb280e4cbced9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:38Z,use_quota=True,user_id='722b2a83f0c94b8aa1b9d295a6ad696e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Creating volume 1dbdcd38-2d7a-4a06-8eac-e51c62e38067 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:36:38 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:38 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067 1073741824 Feb 27 12:36:38 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Flow 'volume_create_manager' (aaedde27-1b52-4947-93dd-de18c8873dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed9f1a43-42f0-483e-8d92-f11f2ea0a214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed9f1a43-42f0-483e-8d92-f11f2ea0a214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-174082058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ae2caf-91b6-4d9d-ae44-70ce8925bdae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611acbb00419421888588878a8dc6eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:38Z,use_quota=True,user_id='8277f83c35ad40fab7ecbb0079e53f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ce6326-0f9e-4f40-8541-6638d7b90335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ce6326-0f9e-4f40-8541-6638d7b90335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b31abac-c4f0-4578-9585-86fed49e7b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b31abac-c4f0-4578-9585-86fed49e7b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6ae2caf-91b6-4d9d-ae44-70ce8925bdae', 'volume_name': 'volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea6dc84-1497-4bdb-a479-5a85cc43cfae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea6dc84-1497-4bdb-a479-5a85cc43cfae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87562b26-0f9c-4254-b47e-bc682f20e4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:38 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Volume c6ae2caf-91b6-4d9d-ae44-70ce8925bdae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae', 'volume_size': 1} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Flow 'volume_create_manager' (aa4a086f-9bc3-4979-9c2b-5412cea7b284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eceabff4-bdbc-49f4-b344-04ba36c8e911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eceabff4-bdbc-49f4-b344-04ba36c8e911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1106479163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40bf7dbf-b8e9-4851-9106-f455a928597e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a123c4d3b37f4298a7bc7f7cd00a2a48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:38Z,use_quota=True,user_id='74057dea2ee441d6881ee8c78e17d36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8148d90f-5fd5-48ce-8feb-c8ac12ff269f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8148d90f-5fd5-48ce-8feb-c8ac12ff269f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47218282-3d86-4a6a-9e8c-24ff4f62cef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47218282-3d86-4a6a-9e8c-24ff4f62cef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40bf7dbf-b8e9-4851-9106-f455a928597e', 'volume_name': 'volume-40bf7dbf-b8e9-4851-9106-f455a928597e', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda87d91-09cd-4358-97c8-02f0862600f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda87d91-09cd-4358-97c8-02f0862600f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9755615e-5738-4655-9f69-0b194adfea21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:38 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Volume 40bf7dbf-b8e9-4851-9106-f455a928597e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40bf7dbf-b8e9-4851-9106-f455a928597e', 'volume_size': 1} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Flow 'volume_create_manager' (3ff6d210-a0e3-4ee0-9740-a7ba4f52fe19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c170b3b9-2543-438e-9770-2c68293c231a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c170b3b9-2543-438e-9770-2c68293c231a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-667189616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94a7ba5-1626-4d74-a278-285cc49e6ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a123c4d3b37f4298a7bc7f7cd00a2a48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:39Z,use_quota=True,user_id='74057dea2ee441d6881ee8c78e17d36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (207b6727-7aa9-4e39-9329-c8d3d4bd56be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (207b6727-7aa9-4e39-9329-c8d3d4bd56be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739d3907-04d4-4079-9fe1-2159f5f4f67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739d3907-04d4-4079-9fe1-2159f5f4f67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a94a7ba5-1626-4d74-a278-285cc49e6ba9', 'volume_name': 'volume-a94a7ba5-1626-4d74-a278-285cc49e6ba9', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e03c8f-db42-4276-abad-cf1029e1f254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e03c8f-db42-4276-abad-cf1029e1f254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd257077-e800-49ae-99ef-d404cf5b1cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:38 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Volume a94a7ba5-1626-4d74-a278-285cc49e6ba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a94a7ba5-1626-4d74-a278-285cc49e6ba9', 'volume_size': 1} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:38 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:38 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Flow 'volume_create_manager' (da423c5e-34d0-4d69-baa6-cec169b2f884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d9a50f-2f76-4e33-9431-15db02e6c16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067 1073741824" returned: 0 in 0.685s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d9a50f-2f76-4e33-9431-15db02e6c16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2092012939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7790b933-3256-487f-8949-8687983cd02d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a123c4d3b37f4298a7bc7f7cd00a2a48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:39Z,use_quota=True,user_id='74057dea2ee441d6881ee8c78e17d36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2294e6e-dc9c-4bb7-80bc-01b581e77e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2294e6e-dc9c-4bb7-80bc-01b581e77e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1444075-dee9-406b-923b-5f584ff3c171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1444075-dee9-406b-923b-5f584ff3c171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7790b933-3256-487f-8949-8687983cd02d', 'volume_name': 'volume-7790b933-3256-487f-8949-8687983cd02d', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0303271e-78e4-489a-b3c4-65ef88d70d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0303271e-78e4-489a-b3c4-65ef88d70d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (446bd768-f0f6-4c6c-b714-d0b5a7ffb590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:39 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Volume 7790b933-3256-487f-8949-8687983cd02d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7790b933-3256-487f-8949-8687983cd02d', 'volume_size': 1} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:39 devstack sudo[90475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067 Feb 27 12:36:39 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Flow 'volume_create_manager' (8d9d57c9-ae75-4fdb-b6d3-bf9d2587129e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209a9028-1968-4899-ad32-cb5a52cff506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209a9028-1968-4899-ad32-cb5a52cff506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-72012058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2983008-7a55-4195-b96a-0c18b18c259b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a123c4d3b37f4298a7bc7f7cd00a2a48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:39Z,use_quota=True,user_id='74057dea2ee441d6881ee8c78e17d36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a883bd80-4fe4-411d-a406-bb102e26562b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a883bd80-4fe4-411d-a406-bb102e26562b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672510c1-392f-4ed9-a0a1-f815f421e15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672510c1-392f-4ed9-a0a1-f815f421e15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2983008-7a55-4195-b96a-0c18b18c259b', 'volume_name': 'volume-c2983008-7a55-4195-b96a-0c18b18c259b', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (247268fb-79e9-439a-9dac-acb99d0e57cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (247268fb-79e9-439a-9dac-acb99d0e57cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b69a183f-324c-4e58-8c90-088f4246c291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:39 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Volume c2983008-7a55-4195-b96a-0c18b18c259b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2983008-7a55-4195-b96a-0c18b18c259b', 'volume_size': 1} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Flow 'volume_create_manager' (18c52c8a-96c0-417b-9afd-1954e09e17c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92fb3990-b099-4613-a1ad-07b4a26ed831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92fb3990-b099-4613-a1ad-07b4a26ed831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1837728701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=655142bd-4aad-4809-b781-bde4c014e750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a123c4d3b37f4298a7bc7f7cd00a2a48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:39Z,use_quota=True,user_id='74057dea2ee441d6881ee8c78e17d36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d81be88-2450-46bb-a564-b208e58eb0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d81be88-2450-46bb-a564-b208e58eb0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f4cba2-6a25-4d59-bf54-3e260c670ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f4cba2-6a25-4d59-bf54-3e260c670ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '655142bd-4aad-4809-b781-bde4c014e750', 'volume_name': 'volume-655142bd-4aad-4809-b781-bde4c014e750', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4186d60-3a5c-4b83-a711-1432ea2b80ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4186d60-3a5c-4b83-a711-1432ea2b80ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b18b5ed0-94b6-416a-98d9-1d9147592251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:39 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Volume 655142bd-4aad-4809-b781-bde4c014e750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-655142bd-4aad-4809-b781-bde4c014e750', 'volume_size': 1} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:39 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067" returned: 0 in 0.579s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.167s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-174082058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ae2caf-91b6-4d9d-ae44-70ce8925bdae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611acbb00419421888588878a8dc6eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:38Z,use_quota=True,user_id='8277f83c35ad40fab7ecbb0079e53f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Creating volume c6ae2caf-91b6-4d9d-ae44-70ce8925bdae {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:36:39 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c54afbc-9019-4bee-a8c2-cf84a6ec83bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e27dac-f4ab-48cf-b534-58c8edcebd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:39 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae 1073741824 Feb 27 12:36:39 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:39 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Volume volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067 (1dbdcd38-2d7a-4a06-8eac-e51c62e38067): created successfully Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e27dac-f4ab-48cf-b534-58c8edcebd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:39 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Flow 'volume_create_manager' (43bacec4-ff42-4f92-8335-794ff5899900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:39 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-2ad1ba81-8342-4ba7-97ef-725db1047a14 tempest-VolumeDependencyTests-56553957 None] Created volume successfully. Feb 27 12:36:40 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae 1073741824" returned: 0 in 0.508s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:40 devstack sudo[90483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae Feb 27 12:36:40 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:40 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae" returned: 0 in 0.419s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:40 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:36:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.042s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:40 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1106479163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40bf7dbf-b8e9-4851-9106-f455a928597e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a123c4d3b37f4298a7bc7f7cd00a2a48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:38Z,use_quota=True,user_id='74057dea2ee441d6881ee8c78e17d36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:36:40 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Creating volume 40bf7dbf-b8e9-4851-9106-f455a928597e {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:36:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:40 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:40 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:40 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:36:40 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:36:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-40bf7dbf-b8e9-4851-9106-f455a928597e 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2ae29710-c0d2-481a-b625-c8c2f52fb6a6 tempest-VolumeDependencyTests-56553957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:40 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87562b26-0f9c-4254-b47e-bc682f20e4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:40 devstack sudo[90486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-40bf7dbf-b8e9-4851-9106-f455a928597e 1073741824 Feb 27 12:36:40 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:40 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236f173c-6fea-48d4-9a01-6f457b638a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:40 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Volume volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae (c6ae2caf-91b6-4d9d-ae44-70ce8925bdae): created successfully Feb 27 12:36:40 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236f173c-6fea-48d4-9a01-6f457b638a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:40 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Flow 'volume_create_manager' (aaedde27-1b52-4947-93dd-de18c8873dd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:40 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-f7ad73cb-f673-4904-bfe7-1924d679e37e tempest-CreateVolumesFromSnapshotTest-1457396782 None] Created volume successfully. Feb 27 12:36:41 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-40bf7dbf-b8e9-4851-9106-f455a928597e 1073741824" returned: 0 in 0.484s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-40bf7dbf-b8e9-4851-9106-f455a928597e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:41 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-40bf7dbf-b8e9-4851-9106-f455a928597e Feb 27 12:36:41 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:41 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-40bf7dbf-b8e9-4851-9106-f455a928597e" returned: 0 in 0.490s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:41 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:36:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.829s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:41 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-667189616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94a7ba5-1626-4d74-a278-285cc49e6ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a123c4d3b37f4298a7bc7f7cd00a2a48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:39Z,use_quota=True,user_id='74057dea2ee441d6881ee8c78e17d36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:36:41 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Creating volume a94a7ba5-1626-4d74-a278-285cc49e6ba9 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:36:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:41 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:41 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:41 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:36:41 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:36:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a94a7ba5-1626-4d74-a278-285cc49e6ba9 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:41 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9755615e-5738-4655-9f69-0b194adfea21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40bf7dbf-b8e9-4851-9106-f455a928597e', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:41 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a94a7ba5-1626-4d74-a278-285cc49e6ba9 1073741824 Feb 27 12:36:41 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:41 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ffd645-d7f5-4c3d-9e8e-76719d23892b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:41 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Volume volume-40bf7dbf-b8e9-4851-9106-f455a928597e (40bf7dbf-b8e9-4851-9106-f455a928597e): created successfully Feb 27 12:36:41 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ffd645-d7f5-4c3d-9e8e-76719d23892b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:41 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Flow 'volume_create_manager' (aa4a086f-9bc3-4979-9c2b-5412cea7b284) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:41 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-de3b44e4-46e0-4ded-9bf5-7625316c4806 tempest-CreateVolumesFromImageTest-693658154 None] Created volume successfully. Feb 27 12:36:41 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bcad346a-4247-4406-b0e5-20a689f6f418 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:42 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a94a7ba5-1626-4d74-a278-285cc49e6ba9 1073741824" returned: 0 in 0.478s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a94a7ba5-1626-4d74-a278-285cc49e6ba9 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:42 devstack sudo[90502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a94a7ba5-1626-4d74-a278-285cc49e6ba9 Feb 27 12:36:42 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:42 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a94a7ba5-1626-4d74-a278-285cc49e6ba9" returned: 0 in 0.475s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:42 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:36:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.573s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:42 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2092012939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7790b933-3256-487f-8949-8687983cd02d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a123c4d3b37f4298a7bc7f7cd00a2a48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:39Z,use_quota=True,user_id='74057dea2ee441d6881ee8c78e17d36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:36:42 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Creating volume 7790b933-3256-487f-8949-8687983cd02d {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:36:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:42 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:42 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:42 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:36:42 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:36:42 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7790b933-3256-487f-8949-8687983cd02d 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:42 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd257077-e800-49ae-99ef-d404cf5b1cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a94a7ba5-1626-4d74-a278-285cc49e6ba9', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:42 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d382c639-7f5a-43ec-8a93-e6eee29d2f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:42 devstack sudo[90506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7790b933-3256-487f-8949-8687983cd02d 1073741824 Feb 27 12:36:42 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Volume volume-a94a7ba5-1626-4d74-a278-285cc49e6ba9 (a94a7ba5-1626-4d74-a278-285cc49e6ba9): created successfully Feb 27 12:36:42 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:42 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d382c639-7f5a-43ec-8a93-e6eee29d2f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:42 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Flow 'volume_create_manager' (3ff6d210-a0e3-4ee0-9740-a7ba4f52fe19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:42 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-04cec495-cf67-4401-96bc-7b77435b559c tempest-CreateVolumesFromImageTest-693658154 None] Created volume successfully. Feb 27 12:36:43 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7790b933-3256-487f-8949-8687983cd02d 1073741824" returned: 0 in 0.595s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7790b933-3256-487f-8949-8687983cd02d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:43 devstack sudo[90511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7790b933-3256-487f-8949-8687983cd02d Feb 27 12:36:43 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:43 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7790b933-3256-487f-8949-8687983cd02d" returned: 0 in 0.528s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:43 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:36:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.552s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:43 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-72012058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2983008-7a55-4195-b96a-0c18b18c259b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a123c4d3b37f4298a7bc7f7cd00a2a48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:39Z,use_quota=True,user_id='74057dea2ee441d6881ee8c78e17d36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:36:43 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Creating volume c2983008-7a55-4195-b96a-0c18b18c259b {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:36:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:43 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:43 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:43 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:36:43 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:36:43 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c2983008-7a55-4195-b96a-0c18b18c259b 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:43 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (446bd768-f0f6-4c6c-b714-d0b5a7ffb590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7790b933-3256-487f-8949-8687983cd02d', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:43 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8883a5e3-412f-429c-828f-10603b623b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:43 devstack sudo[90514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c2983008-7a55-4195-b96a-0c18b18c259b 1073741824 Feb 27 12:36:43 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:43 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Volume volume-7790b933-3256-487f-8949-8687983cd02d (7790b933-3256-487f-8949-8687983cd02d): created successfully Feb 27 12:36:43 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8883a5e3-412f-429c-828f-10603b623b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:43 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Flow 'volume_create_manager' (da423c5e-34d0-4d69-baa6-cec169b2f884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:43 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-a82e2f0d-158b-4979-b707-87ff77a8a337 tempest-CreateVolumesFromImageTest-693658154 None] Created volume successfully. Feb 27 12:36:44 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c2983008-7a55-4195-b96a-0c18b18c259b 1073741824" returned: 0 in 0.521s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c2983008-7a55-4195-b96a-0c18b18c259b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:44 devstack sudo[90519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c2983008-7a55-4195-b96a-0c18b18c259b Feb 27 12:36:44 devstack sudo[90519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:44 devstack sudo[90519]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c2983008-7a55-4195-b96a-0c18b18c259b" returned: 0 in 0.432s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:44 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:36:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.309s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:44 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1837728701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=655142bd-4aad-4809-b781-bde4c014e750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a123c4d3b37f4298a7bc7f7cd00a2a48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:39Z,use_quota=True,user_id='74057dea2ee441d6881ee8c78e17d36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:36:44 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Creating volume 655142bd-4aad-4809-b781-bde4c014e750 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:36:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:44 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:44 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:44 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:36:44 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:36:44 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-655142bd-4aad-4809-b781-bde4c014e750 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b69a183f-324c-4e58-8c90-088f4246c291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2983008-7a55-4195-b96a-0c18b18c259b', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:44 devstack sudo[90522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-655142bd-4aad-4809-b781-bde4c014e750 1073741824 Feb 27 12:36:44 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3544b8d-1c2d-43b0-a94b-85e5bf7dfcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:44 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Volume volume-c2983008-7a55-4195-b96a-0c18b18c259b (c2983008-7a55-4195-b96a-0c18b18c259b): created successfully Feb 27 12:36:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3544b8d-1c2d-43b0-a94b-85e5bf7dfcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:44 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Flow 'volume_create_manager' (8d9d57c9-ae75-4fdb-b6d3-bf9d2587129e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:44 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-06466a0c-6ce7-40b4-a7c0-b2da0ece880b tempest-CreateVolumesFromImageTest-693658154 None] Created volume successfully. Feb 27 12:36:45 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-655142bd-4aad-4809-b781-bde4c014e750 1073741824" returned: 0 in 0.540s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-655142bd-4aad-4809-b781-bde4c014e750 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:45 devstack sudo[90527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-655142bd-4aad-4809-b781-bde4c014e750 Feb 27 12:36:45 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:45 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-655142bd-4aad-4809-b781-bde4c014e750" returned: 0 in 0.478s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:45 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:36:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2ae29710-c0d2-481a-b625-c8c2f52fb6a6 tempest-VolumeDependencyTests-56553957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.194s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b18b5ed0-94b6-416a-98d9-1d9147592251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-655142bd-4aad-4809-b781-bde4c014e750', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a434284b-2f44-4f9b-994e-c4321009bb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:45 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-2ae29710-c0d2-481a-b625-c8c2f52fb6a6 tempest-VolumeDependencyTests-56553957 None] Creating offline snapshot a7fef6a4-046c-4928-af04-aa7f68915f57 of volume 1dbdcd38-2d7a-4a06-8eac-e51c62e38067 {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:36:45 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Volume volume-655142bd-4aad-4809-b781-bde4c014e750 (655142bd-4aad-4809-b781-bde4c014e750): created successfully Feb 27 12:36:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a434284b-2f44-4f9b-994e-c4321009bb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:45 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Flow 'volume_create_manager' (18c52c8a-96c0-417b-9afd-1954e09e17c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:45 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[634c042d-a95a-4afa-81d6-adf7f490f9e8]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:45 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2ae29710-c0d2-481a-b625-c8c2f52fb6a6 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:45 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-36b9d8a1-90e3-40bf-9936-4be15f13ac39 tempest-CreateVolumesFromImageTest-693658154 None] Created volume successfully. Feb 27 12:36:46 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-fcdfd48b-e725-4b2a-ad6f-258cbf718e93 tempest-CreateVolumesFromImageTest-693658154 None] Acquiring lock "cinder-655142bd-4aad-4809-b781-bde4c014e750-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:46 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-fcdfd48b-e725-4b2a-ad6f-258cbf718e93 tempest-CreateVolumesFromImageTest-693658154 None] Lock "cinder-655142bd-4aad-4809-b781-bde4c014e750-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:46 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067 Feb 27 12:36:46 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:46 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-fcdfd48b-e725-4b2a-ad6f-258cbf718e93 tempest-CreateVolumesFromImageTest-693658154 None] Acquiring lock "cinder-quobyte-655142bd-4aad-4809-b781-bde4c014e750" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:46 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-fcdfd48b-e725-4b2a-ad6f-258cbf718e93 tempest-CreateVolumesFromImageTest-693658154 None] Lock "cinder-quobyte-655142bd-4aad-4809-b781-bde4c014e750" acquired by "delete_volume" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:46 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d33ec3-0029-4bb5-b12c-203dbddd6fb9]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-fcdfd48b-e725-4b2a-ad6f-258cbf718e93 tempest-CreateVolumesFromImageTest-693658154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-655142bd-4aad-4809-b781-bde4c014e750 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:46 devstack sudo[90532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-655142bd-4aad-4809-b781-bde4c014e750 Feb 27 12:36:46 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:46 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2ae29710-c0d2-481a-b625-c8c2f52fb6a6 tempest-VolumeDependencyTests-56553957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067" returned: 0 in 0.559s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2ae29710-c0d2-481a-b625-c8c2f52fb6a6 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.a7fef6a4-046c-4928-af04-aa7f68915f57 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:46 devstack sudo[90537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.a7fef6a4-046c-4928-af04-aa7f68915f57 1G Feb 27 12:36:46 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:46 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-fcdfd48b-e725-4b2a-ad6f-258cbf718e93 tempest-CreateVolumesFromImageTest-693658154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-655142bd-4aad-4809-b781-bde4c014e750" returned: 0 in 0.542s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:46 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-fcdfd48b-e725-4b2a-ad6f-258cbf718e93 tempest-CreateVolumesFromImageTest-693658154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-655142bd-4aad-4809-b781-bde4c014e750 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:46 devstack sudo[90542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-655142bd-4aad-4809-b781-bde4c014e750 Feb 27 12:36:46 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:47 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2ae29710-c0d2-481a-b625-c8c2f52fb6a6 tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.a7fef6a4-046c-4928-af04-aa7f68915f57 1G" returned: 0 in 0.554s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2ae29710-c0d2-481a-b625-c8c2f52fb6a6 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.a7fef6a4-046c-4928-af04-aa7f68915f57 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:47 devstack sudo[90547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.a7fef6a4-046c-4928-af04-aa7f68915f57 Feb 27 12:36:47 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:47 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-fcdfd48b-e725-4b2a-ad6f-258cbf718e93 tempest-CreateVolumesFromImageTest-693658154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-655142bd-4aad-4809-b781-bde4c014e750" returned: 0 in 0.529s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:47 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-fcdfd48b-e725-4b2a-ad6f-258cbf718e93 tempest-CreateVolumesFromImageTest-693658154 None] Lock "cinder-quobyte-655142bd-4aad-4809-b781-bde4c014e750" released by "delete_volume" :: held 1.098s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:47 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-fcdfd48b-e725-4b2a-ad6f-258cbf718e93 tempest-CreateVolumesFromImageTest-693658154 None] Created reservations ['353b24cc-0c7b-41e7-bb22-bde43164117c', '55574dd1-c08d-4e6d-b200-c3aa35fa47b9', '3f49c541-033b-4828-af0e-f549a1a9ba91', '81a2b59e-fe69-4d14-97ce-06032ed05151'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:36:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-fcdfd48b-e725-4b2a-ad6f-258cbf718e93 tempest-CreateVolumesFromImageTest-693658154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-fcdfd48b-e725-4b2a-ad6f-258cbf718e93 tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:47 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-fcdfd48b-e725-4b2a-ad6f-258cbf718e93 tempest-CreateVolumesFromImageTest-693658154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:47 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-fcdfd48b-e725-4b2a-ad6f-258cbf718e93 tempest-CreateVolumesFromImageTest-693658154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-fcdfd48b-e725-4b2a-ad6f-258cbf718e93 tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-fcdfd48b-e725-4b2a-ad6f-258cbf718e93 tempest-CreateVolumesFromImageTest-693658154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:47 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:36:47 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:47 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2ae29710-c0d2-481a-b625-c8c2f52fb6a6 tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.a7fef6a4-046c-4928-af04-aa7f68915f57" returned: 0 in 0.517s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:47 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-2ae29710-c0d2-481a-b625-c8c2f52fb6a6 tempest-VolumeDependencyTests-56553957 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.a7fef6a4-046c-4928-af04-aa7f68915f57 is being set with open permissions: ugo+rw Feb 27 12:36:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2ae29710-c0d2-481a-b625-c8c2f52fb6a6 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.a7fef6a4-046c-4928-af04-aa7f68915f57 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:47 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.a7fef6a4-046c-4928-af04-aa7f68915f57 Feb 27 12:36:47 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:47 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:47 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-fcdfd48b-e725-4b2a-ad6f-258cbf718e93 tempest-CreateVolumesFromImageTest-693658154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.500s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:47 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-fcdfd48b-e725-4b2a-ad6f-258cbf718e93 tempest-CreateVolumesFromImageTest-693658154 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:36:47 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-fcdfd48b-e725-4b2a-ad6f-258cbf718e93 tempest-CreateVolumesFromImageTest-693658154 None] Deleted volume successfully. Feb 27 12:36:47 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-fcdfd48b-e725-4b2a-ad6f-258cbf718e93 tempest-CreateVolumesFromImageTest-693658154 None] Lock "cinder-655142bd-4aad-4809-b781-bde4c014e750-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:48 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2ae29710-c0d2-481a-b625-c8c2f52fb6a6 tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.a7fef6a4-046c-4928-af04-aa7f68915f57" returned: 0 in 0.497s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2ae29710-c0d2-481a-b625-c8c2f52fb6a6 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:48 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.info Feb 27 12:36:48 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:48 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f5703123-9c61-478a-abe8-8048fb9b2d04 tempest-CreateVolumesFromImageTest-693658154 None] Acquiring lock "cinder-c2983008-7a55-4195-b96a-0c18b18c259b-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:48 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f5703123-9c61-478a-abe8-8048fb9b2d04 tempest-CreateVolumesFromImageTest-693658154 None] Lock "cinder-c2983008-7a55-4195-b96a-0c18b18c259b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:48 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f5703123-9c61-478a-abe8-8048fb9b2d04 tempest-CreateVolumesFromImageTest-693658154 None] Acquiring lock "cinder-quobyte-c2983008-7a55-4195-b96a-0c18b18c259b" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:48 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f5703123-9c61-478a-abe8-8048fb9b2d04 tempest-CreateVolumesFromImageTest-693658154 None] Lock "cinder-quobyte-c2983008-7a55-4195-b96a-0c18b18c259b" acquired by "delete_volume" :: waited 0.012s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:48 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cb605a-9cea-4e8e-bfa5-f7ab933cd72a]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f5703123-9c61-478a-abe8-8048fb9b2d04 tempest-CreateVolumesFromImageTest-693658154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c2983008-7a55-4195-b96a-0c18b18c259b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:48 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c2983008-7a55-4195-b96a-0c18b18c259b Feb 27 12:36:48 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:48 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2ae29710-c0d2-481a-b625-c8c2f52fb6a6 tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.info" returned: 0 in 0.449s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:48 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-2ae29710-c0d2-481a-b625-c8c2f52fb6a6 tempest-VolumeDependencyTests-56553957 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.info is being set with open permissions: ugo+rw Feb 27 12:36:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2ae29710-c0d2-481a-b625-c8c2f52fb6a6 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:48 devstack sudo[90565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.info Feb 27 12:36:48 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:48 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f5703123-9c61-478a-abe8-8048fb9b2d04 tempest-CreateVolumesFromImageTest-693658154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c2983008-7a55-4195-b96a-0c18b18c259b" returned: 0 in 0.611s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:48 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f5703123-9c61-478a-abe8-8048fb9b2d04 tempest-CreateVolumesFromImageTest-693658154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c2983008-7a55-4195-b96a-0c18b18c259b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:48 devstack sudo[90570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c2983008-7a55-4195-b96a-0c18b18c259b Feb 27 12:36:48 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:49 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2ae29710-c0d2-481a-b625-c8c2f52fb6a6 tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.info" returned: 0 in 0.525s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2ae29710-c0d2-481a-b625-c8c2f52fb6a6 tempest-VolumeDependencyTests-56553957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.228s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bcad346a-4247-4406-b0e5-20a689f6f418 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.328s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:49 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-2ae29710-c0d2-481a-b625-c8c2f52fb6a6 tempest-VolumeDependencyTests-56553957 None] Create snapshot completed successfully Feb 27 12:36:49 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-bcad346a-4247-4406-b0e5-20a689f6f418 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Creating offline snapshot 671efea7-015d-4b15-a2e6-e0524a7cda8f of volume c6ae2caf-91b6-4d9d-ae44-70ce8925bdae {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:36:49 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdf921d-ade7-407f-901b-1a5242dc2bc2]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bcad346a-4247-4406-b0e5-20a689f6f418 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:49 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae Feb 27 12:36:49 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:49 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f5703123-9c61-478a-abe8-8048fb9b2d04 tempest-CreateVolumesFromImageTest-693658154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c2983008-7a55-4195-b96a-0c18b18c259b" returned: 0 in 0.485s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:49 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f5703123-9c61-478a-abe8-8048fb9b2d04 tempest-CreateVolumesFromImageTest-693658154 None] Lock "cinder-quobyte-c2983008-7a55-4195-b96a-0c18b18c259b" released by "delete_volume" :: held 1.123s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:49 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-f5703123-9c61-478a-abe8-8048fb9b2d04 tempest-CreateVolumesFromImageTest-693658154 None] Created reservations ['a658cca7-1567-4077-8318-a32d08b1b8fd', '5779c373-2c31-434e-8ade-40a63d153850', '195199d2-ad7e-4d0c-9b68-37679237ca0b', 'a251fdec-baaf-4125-b0ae-f6d8cab33ac4'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:36:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f5703123-9c61-478a-abe8-8048fb9b2d04 tempest-CreateVolumesFromImageTest-693658154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f5703123-9c61-478a-abe8-8048fb9b2d04 tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:49 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f5703123-9c61-478a-abe8-8048fb9b2d04 tempest-CreateVolumesFromImageTest-693658154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:49 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f5703123-9c61-478a-abe8-8048fb9b2d04 tempest-CreateVolumesFromImageTest-693658154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f5703123-9c61-478a-abe8-8048fb9b2d04 tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f5703123-9c61-478a-abe8-8048fb9b2d04 tempest-CreateVolumesFromImageTest-693658154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:49 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:36:49 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:49 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bcad346a-4247-4406-b0e5-20a689f6f418 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae" returned: 0 in 0.594s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bcad346a-4247-4406-b0e5-20a689f6f418 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae.671efea7-015d-4b15-a2e6-e0524a7cda8f 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:49 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae.671efea7-015d-4b15-a2e6-e0524a7cda8f 1G Feb 27 12:36:49 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:49 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:49 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f5703123-9c61-478a-abe8-8048fb9b2d04 tempest-CreateVolumesFromImageTest-693658154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.461s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:49 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-f5703123-9c61-478a-abe8-8048fb9b2d04 tempest-CreateVolumesFromImageTest-693658154 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:36:49 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-f5703123-9c61-478a-abe8-8048fb9b2d04 tempest-CreateVolumesFromImageTest-693658154 None] Deleted volume successfully. Feb 27 12:36:49 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f5703123-9c61-478a-abe8-8048fb9b2d04 tempest-CreateVolumesFromImageTest-693658154 None] Lock "cinder-c2983008-7a55-4195-b96a-0c18b18c259b-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:50 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:50 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Flow 'volume_create_manager' (7190deea-f76a-4c43-a335-4c4f5915557a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:50 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ee926f-f061-4f2d-a7bd-f8bf5ac411c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:50 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ee926f-f061-4f2d-a7bd-f8bf5ac411c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1889127119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e1790ea-2934-42a8-a204-5ccfa2f6946b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d4990b860b4747be7eb280e4cbced9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a7fef6a4-046c-4928-af04-aa7f68915f57,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:50Z,use_quota=True,user_id='722b2a83f0c94b8aa1b9d295a6ad696e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:50 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:50 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9049265b-82d6-4721-84dd-cfb4beb59ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:50 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9049265b-82d6-4721-84dd-cfb4beb59ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:50 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71289b6b-6221-49f4-9981-967fa51402b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:50 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71289b6b-6221-49f4-9981-967fa51402b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3e1790ea-2934-42a8-a204-5ccfa2f6946b', 'volume_name': 'volume-3e1790ea-2934-42a8-a204-5ccfa2f6946b', 'volume_size': 1, 'snapshot_id': 'a7fef6a4-046c-4928-af04-aa7f68915f57'}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:50 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d49ee5-7bc3-48ce-9425-8622b6431b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:50 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d49ee5-7bc3-48ce-9425-8622b6431b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:50 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1f9ff2-ef4a-473d-8154-2222d4ff46ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:50 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Volume 3e1790ea-2934-42a8-a204-5ccfa2f6946b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3e1790ea-2934-42a8-a204-5ccfa2f6946b', 'volume_size': 1, 'snapshot_id': 'a7fef6a4-046c-4928-af04-aa7f68915f57'} Feb 27 12:36:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bcad346a-4247-4406-b0e5-20a689f6f418 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae.671efea7-015d-4b15-a2e6-e0524a7cda8f 1G" returned: 0 in 0.676s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bcad346a-4247-4406-b0e5-20a689f6f418 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae.671efea7-015d-4b15-a2e6-e0524a7cda8f {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:50 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae.671efea7-015d-4b15-a2e6-e0524a7cda8f Feb 27 12:36:50 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:50 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-be7f84f3-243a-4ef2-8a65-a42896eb7212 tempest-CreateVolumesFromImageTest-693658154 None] Acquiring lock "cinder-7790b933-3256-487f-8949-8687983cd02d-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:50 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-be7f84f3-243a-4ef2-8a65-a42896eb7212 tempest-CreateVolumesFromImageTest-693658154 None] Lock "cinder-7790b933-3256-487f-8949-8687983cd02d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:50 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-be7f84f3-243a-4ef2-8a65-a42896eb7212 tempest-CreateVolumesFromImageTest-693658154 None] Acquiring lock "cinder-quobyte-7790b933-3256-487f-8949-8687983cd02d" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:50 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-be7f84f3-243a-4ef2-8a65-a42896eb7212 tempest-CreateVolumesFromImageTest-693658154 None] Lock "cinder-quobyte-7790b933-3256-487f-8949-8687983cd02d" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:50 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ff3921-7d22-4d96-91d1-2e9484389820]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-be7f84f3-243a-4ef2-8a65-a42896eb7212 tempest-CreateVolumesFromImageTest-693658154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7790b933-3256-487f-8949-8687983cd02d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:50 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7790b933-3256-487f-8949-8687983cd02d Feb 27 12:36:50 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:50 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bcad346a-4247-4406-b0e5-20a689f6f418 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae.671efea7-015d-4b15-a2e6-e0524a7cda8f" returned: 0 in 0.476s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:50 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-bcad346a-4247-4406-b0e5-20a689f6f418 tempest-CreateVolumesFromSnapshotTest-1457396782 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae.671efea7-015d-4b15-a2e6-e0524a7cda8f is being set with open permissions: ugo+rw Feb 27 12:36:50 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bcad346a-4247-4406-b0e5-20a689f6f418 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae.671efea7-015d-4b15-a2e6-e0524a7cda8f {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:50 devstack sudo[90594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae.671efea7-015d-4b15-a2e6-e0524a7cda8f Feb 27 12:36:50 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:51 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-be7f84f3-243a-4ef2-8a65-a42896eb7212 tempest-CreateVolumesFromImageTest-693658154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7790b933-3256-487f-8949-8687983cd02d" returned: 0 in 0.567s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-be7f84f3-243a-4ef2-8a65-a42896eb7212 tempest-CreateVolumesFromImageTest-693658154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7790b933-3256-487f-8949-8687983cd02d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:51 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7790b933-3256-487f-8949-8687983cd02d Feb 27 12:36:51 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:51 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bcad346a-4247-4406-b0e5-20a689f6f418 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae.671efea7-015d-4b15-a2e6-e0524a7cda8f" returned: 0 in 0.434s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bcad346a-4247-4406-b0e5-20a689f6f418 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:51 devstack sudo[90603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae.info Feb 27 12:36:51 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:51 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-be7f84f3-243a-4ef2-8a65-a42896eb7212 tempest-CreateVolumesFromImageTest-693658154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7790b933-3256-487f-8949-8687983cd02d" returned: 0 in 0.472s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:51 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-be7f84f3-243a-4ef2-8a65-a42896eb7212 tempest-CreateVolumesFromImageTest-693658154 None] Lock "cinder-quobyte-7790b933-3256-487f-8949-8687983cd02d" released by "delete_volume" :: held 1.067s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:51 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-be7f84f3-243a-4ef2-8a65-a42896eb7212 tempest-CreateVolumesFromImageTest-693658154 None] Created reservations ['4b205cae-1de9-4e2f-8e42-10a3caa45d20', '6270ad2a-20b3-45e0-8534-6027841ee61b', 'e87e07ad-5095-46f8-a7ae-0c5d3293b7ea', '4ce4610f-daf2-42f5-a061-012f4944b247'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:36:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-be7f84f3-243a-4ef2-8a65-a42896eb7212 tempest-CreateVolumesFromImageTest-693658154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-be7f84f3-243a-4ef2-8a65-a42896eb7212 tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:51 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-be7f84f3-243a-4ef2-8a65-a42896eb7212 tempest-CreateVolumesFromImageTest-693658154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:51 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-be7f84f3-243a-4ef2-8a65-a42896eb7212 tempest-CreateVolumesFromImageTest-693658154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-be7f84f3-243a-4ef2-8a65-a42896eb7212 tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-be7f84f3-243a-4ef2-8a65-a42896eb7212 tempest-CreateVolumesFromImageTest-693658154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:51 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:36:51 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:51 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bcad346a-4247-4406-b0e5-20a689f6f418 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae.info" returned: 0 in 0.459s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:51 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-bcad346a-4247-4406-b0e5-20a689f6f418 tempest-CreateVolumesFromSnapshotTest-1457396782 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae.info is being set with open permissions: ugo+rw Feb 27 12:36:51 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bcad346a-4247-4406-b0e5-20a689f6f418 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:51 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae.info Feb 27 12:36:51 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:52 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-be7f84f3-243a-4ef2-8a65-a42896eb7212 tempest-CreateVolumesFromImageTest-693658154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.488s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-be7f84f3-243a-4ef2-8a65-a42896eb7212 tempest-CreateVolumesFromImageTest-693658154 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:36:52 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-be7f84f3-243a-4ef2-8a65-a42896eb7212 tempest-CreateVolumesFromImageTest-693658154 None] Deleted volume successfully. Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-be7f84f3-243a-4ef2-8a65-a42896eb7212 tempest-CreateVolumesFromImageTest-693658154 None] Lock "cinder-7790b933-3256-487f-8949-8687983cd02d-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:52 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bcad346a-4247-4406-b0e5-20a689f6f418 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae.info" returned: 0 in 0.504s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bcad346a-4247-4406-b0e5-20a689f6f418 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.215s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.892s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Acquiring lock "cinder-quobyte-a7fef6a4-046c-4928-af04-aa7f68915f57-3e1790ea-2934-42a8-a204-5ccfa2f6946b" by "_create_volume_from_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Lock "cinder-quobyte-a7fef6a4-046c-4928-af04-aa7f68915f57-3e1790ea-2934-42a8-a204-5ccfa2f6946b" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Creating volume 3e1790ea-2934-42a8-a204-5ccfa2f6946b from snapshot a7fef6a4-046c-4928-af04-aa7f68915f57 {{(pid=83077) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Acquiring lock "cinder-quobyte-3e1790ea-2934-42a8-a204-5ccfa2f6946b" by "_copy_volume_from_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:52 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-bcad346a-4247-4406-b0e5-20a689f6f418 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Create snapshot completed successfully Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Lock "cinder-quobyte-3e1790ea-2934-42a8-a204-5ccfa2f6946b" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] snapshot: a7fef6a4-046c-4928-af04-aa7f68915f57, volume: 3e1790ea-2934-42a8-a204-5ccfa2f6946b, {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d2a446-83e7-4a52-b92e-f0245a5ead70]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.a7fef6a4-046c-4928-af04-aa7f68915f57 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:52 devstack sudo[90613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.a7fef6a4-046c-4928-af04-aa7f68915f57 Feb 27 12:36:52 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cd2e272e-6b44-4eb7-a938-265c287aedd4 tempest-CreateVolumesFromImageTest-693658154 None] Acquiring lock "cinder-a94a7ba5-1626-4d74-a278-285cc49e6ba9-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cd2e272e-6b44-4eb7-a938-265c287aedd4 tempest-CreateVolumesFromImageTest-693658154 None] Lock "cinder-a94a7ba5-1626-4d74-a278-285cc49e6ba9-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cd2e272e-6b44-4eb7-a938-265c287aedd4 tempest-CreateVolumesFromImageTest-693658154 None] Acquiring lock "cinder-quobyte-a94a7ba5-1626-4d74-a278-285cc49e6ba9" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cd2e272e-6b44-4eb7-a938-265c287aedd4 tempest-CreateVolumesFromImageTest-693658154 None] Lock "cinder-quobyte-a94a7ba5-1626-4d74-a278-285cc49e6ba9" acquired by "delete_volume" :: waited 0.015s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[501a7e8f-bb9b-40db-bccd-9fa0e473387b]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cd2e272e-6b44-4eb7-a938-265c287aedd4 tempest-CreateVolumesFromImageTest-693658154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a94a7ba5-1626-4d74-a278-285cc49e6ba9 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:52 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a94a7ba5-1626-4d74-a278-285cc49e6ba9 Feb 27 12:36:52 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:52 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:52 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.a7fef6a4-046c-4928-af04-aa7f68915f57" returned: 0 in 0.625s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:53 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:36:53 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067 {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 12:36:53 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Creating direct copy from snapshot {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 12:36:53 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf614605-64b6-4564-ab95-96b1aa731209]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:53 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067 Feb 27 12:36:53 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:53 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cd2e272e-6b44-4eb7-a938-265c287aedd4 tempest-CreateVolumesFromImageTest-693658154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a94a7ba5-1626-4d74-a278-285cc49e6ba9" returned: 0 in 0.605s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cd2e272e-6b44-4eb7-a938-265c287aedd4 tempest-CreateVolumesFromImageTest-693658154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a94a7ba5-1626-4d74-a278-285cc49e6ba9 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:53 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a94a7ba5-1626-4d74-a278-285cc49e6ba9 Feb 27 12:36:53 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:53 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:53 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:53 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Flow 'volume_create_manager' (68f8d4ab-857c-4496-9b57-e4c8e1cb5c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:53 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9731f292-d492-4fb5-be0c-dad2cb12b223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067" returned: 0 in 0.839s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:53 devstack cinder-volume[83077]: DEBUG cinder.utils [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Path /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-3e1790ea-2934-42a8-a204-5ccfa2f6946b not found in is_blk_device check {{(pid=83077) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 12:36:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-3e1790ea-2934-42a8-a204-5ccfa2f6946b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:53 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9731f292-d492-4fb5-be0c-dad2cb12b223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1227534782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2733f4-f9bf-43cf-903a-4923b40ac319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611acbb00419421888588878a8dc6eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:54Z,use_quota=True,user_id='8277f83c35ad40fab7ecbb0079e53f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:53 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-3e1790ea-2934-42a8-a204-5ccfa2f6946b Feb 27 12:36:53 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:53 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e04b9c59-df27-4fc3-96e4-ee09bab2dddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:53 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e04b9c59-df27-4fc3-96e4-ee09bab2dddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:53 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (003487c0-c39e-4bca-b680-422d662b5718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:53 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (003487c0-c39e-4bca-b680-422d662b5718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb2733f4-f9bf-43cf-903a-4923b40ac319', 'volume_name': 'volume-fb2733f4-f9bf-43cf-903a-4923b40ac319', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:53 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f773bfc0-6207-4add-b39e-cab82bf4aaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:53 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f773bfc0-6207-4add-b39e-cab82bf4aaa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:53 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07626365-be58-4f50-955b-1bf71c85802f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:53 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Volume fb2733f4-f9bf-43cf-903a-4923b40ac319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb2733f4-f9bf-43cf-903a-4923b40ac319', 'volume_size': 1} Feb 27 12:36:53 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Flow 'volume_create_manager' (1d3d1c6f-9ca4-4afb-92de-4716512f1749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bad0d8e4-fd10-4d5a-b5e9-229c50d748df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bad0d8e4-fd10-4d5a-b5e9-229c50d748df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1509414122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c93b172e-5f21-41df-82c6-500b27540966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611acbb00419421888588878a8dc6eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:54Z,use_quota=True,user_id='8277f83c35ad40fab7ecbb0079e53f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31fc47f4-ca63-490a-bbdd-b4e809ab117e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31fc47f4-ca63-490a-bbdd-b4e809ab117e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3fc77a-561a-4cdf-8ddf-4b556f666644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3fc77a-561a-4cdf-8ddf-4b556f666644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c93b172e-5f21-41df-82c6-500b27540966', 'volume_name': 'volume-c93b172e-5f21-41df-82c6-500b27540966', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b37bfb2-ca1f-4864-8bbc-abc7e05d59bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b37bfb2-ca1f-4864-8bbc-abc7e05d59bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa7ada9-6f9d-450b-b6fa-6c80c1edf223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:54 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Volume c93b172e-5f21-41df-82c6-500b27540966: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c93b172e-5f21-41df-82c6-500b27540966', 'volume_size': 1} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Flow 'volume_create_manager' (d0902234-4c34-469d-aef3-daefb870f5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73c6015f-066c-4554-aa64-3c6deaefd5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73c6015f-066c-4554-aa64-3c6deaefd5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-734397956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c95072e1-f1c5-42c3-9435-1942edcd3983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611acbb00419421888588878a8dc6eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:54Z,use_quota=True,user_id='8277f83c35ad40fab7ecbb0079e53f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (517e0339-c493-4240-9297-bdcd04147f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (517e0339-c493-4240-9297-bdcd04147f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:54 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ceac27-296f-4b6b-a902-c84c9950e583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ceac27-296f-4b6b-a902-c84c9950e583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c95072e1-f1c5-42c3-9435-1942edcd3983', 'volume_name': 'volume-c95072e1-f1c5-42c3-9435-1942edcd3983', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed8e574-4329-4628-8028-7796ea818a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed8e574-4329-4628-8028-7796ea818a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (028cb643-e12b-402a-b22a-257b6b7fe8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:54 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Volume c95072e1-f1c5-42c3-9435-1942edcd3983: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c95072e1-f1c5-42c3-9435-1942edcd3983', 'volume_size': 1} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cd2e272e-6b44-4eb7-a938-265c287aedd4 tempest-CreateVolumesFromImageTest-693658154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-a94a7ba5-1626-4d74-a278-285cc49e6ba9" returned: 0 in 1.100s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cd2e272e-6b44-4eb7-a938-265c287aedd4 tempest-CreateVolumesFromImageTest-693658154 None] Lock "cinder-quobyte-a94a7ba5-1626-4d74-a278-285cc49e6ba9" released by "delete_volume" :: held 1.738s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Flow 'volume_create_manager' (28d3d6be-acfc-4954-b29f-96e4e88538d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a956f7a-df65-40d4-8d66-46124d8b877f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Flow 'volume_create_manager' (a2651286-fd83-428d-9cdc-e665b51a38da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac8c7dd-a3fc-4843-afca-b9f321c90b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-cd2e272e-6b44-4eb7-a938-265c287aedd4 tempest-CreateVolumesFromImageTest-693658154 None] Created reservations ['94c86f28-a27f-4cf1-9a34-8bd80ef066cf', 'e5d2bfb1-d0d1-4113-98bb-ff1b79f42661', '895c190c-754b-499b-85fc-9a543ae6add2', 'd4017fcb-7dc2-4923-88e2-53f10ca87a50'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a956f7a-df65-40d4-8d66-46124d8b877f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-459583007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=490313ac-b708-47fe-b5e7-6b0a3bb316df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611acbb00419421888588878a8dc6eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:54Z,use_quota=True,user_id='8277f83c35ad40fab7ecbb0079e53f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a37503f-a5f7-4b06-aa2b-fc2acf12f489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a37503f-a5f7-4b06-aa2b-fc2acf12f489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4037dc3b-559d-462d-a18e-26ca736e2fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4037dc3b-559d-462d-a18e-26ca736e2fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '490313ac-b708-47fe-b5e7-6b0a3bb316df', 'volume_name': 'volume-490313ac-b708-47fe-b5e7-6b0a3bb316df', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ed6ff6-ac8d-4606-a3e5-95697dcc79ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ed6ff6-ac8d-4606-a3e5-95697dcc79ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f4b2eb-aa46-4dc0-a877-0691635f50af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:54 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Volume 490313ac-b708-47fe-b5e7-6b0a3bb316df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-490313ac-b708-47fe-b5e7-6b0a3bb316df', 'volume_size': 1} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac8c7dd-a3fc-4843-afca-b9f321c90b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1022831174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59213351-9eb4-4ab2-bafe-d01a0002884c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611acbb00419421888588878a8dc6eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:54Z,use_quota=True,user_id='8277f83c35ad40fab7ecbb0079e53f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8cde38b-6943-4d92-82c5-9b7b997bbab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8cde38b-6943-4d92-82c5-9b7b997bbab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba6288e-4b16-49c1-a6e8-e06bbd04518f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba6288e-4b16-49c1-a6e8-e06bbd04518f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59213351-9eb4-4ab2-bafe-d01a0002884c', 'volume_name': 'volume-59213351-9eb4-4ab2-bafe-d01a0002884c', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d335197b-da14-4686-9e8b-cedb32075e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d335197b-da14-4686-9e8b-cedb32075e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d548270-bb71-42ab-ad8b-0cf5039fa904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:54 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Volume 59213351-9eb4-4ab2-bafe-d01a0002884c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59213351-9eb4-4ab2-bafe-d01a0002884c', 'volume_size': 1} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-cd2e272e-6b44-4eb7-a938-265c287aedd4 tempest-CreateVolumesFromImageTest-693658154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-cd2e272e-6b44-4eb7-a938-265c287aedd4 tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-cd2e272e-6b44-4eb7-a938-265c287aedd4 tempest-CreateVolumesFromImageTest-693658154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-cd2e272e-6b44-4eb7-a938-265c287aedd4 tempest-CreateVolumesFromImageTest-693658154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-cd2e272e-6b44-4eb7-a938-265c287aedd4 tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cd2e272e-6b44-4eb7-a938-265c287aedd4 tempest-CreateVolumesFromImageTest-693658154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:54 devstack sudo[90653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:36:54 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4cdb1bc6-9993-40ef-8416-5e55c2df32f9 tempest-CreateVolumesFromImageTest-693658154 None] Acquiring lock "cinder-40bf7dbf-b8e9-4851-9106-f455a928597e-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:54 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4cdb1bc6-9993-40ef-8416-5e55c2df32f9 tempest-CreateVolumesFromImageTest-693658154 None] Lock "cinder-40bf7dbf-b8e9-4851-9106-f455a928597e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:55 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4cdb1bc6-9993-40ef-8416-5e55c2df32f9 tempest-CreateVolumesFromImageTest-693658154 None] Acquiring lock "cinder-quobyte-40bf7dbf-b8e9-4851-9106-f455a928597e" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:55 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4cdb1bc6-9993-40ef-8416-5e55c2df32f9 tempest-CreateVolumesFromImageTest-693658154 None] Lock "cinder-quobyte-40bf7dbf-b8e9-4851-9106-f455a928597e" acquired by "delete_volume" :: waited 0.060s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:55 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b4c07d-11db-4d71-af8f-44de0da63473]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:55 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4cdb1bc6-9993-40ef-8416-5e55c2df32f9 tempest-CreateVolumesFromImageTest-693658154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-40bf7dbf-b8e9-4851-9106-f455a928597e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:55 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-40bf7dbf-b8e9-4851-9106-f455a928597e Feb 27 12:36:55 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:56 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cd2e272e-6b44-4eb7-a938-265c287aedd4 tempest-CreateVolumesFromImageTest-693658154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 1.381s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:56 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-cd2e272e-6b44-4eb7-a938-265c287aedd4 tempest-CreateVolumesFromImageTest-693658154 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:36:56 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-cd2e272e-6b44-4eb7-a938-265c287aedd4 tempest-CreateVolumesFromImageTest-693658154 None] Deleted volume successfully. Feb 27 12:36:56 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cd2e272e-6b44-4eb7-a938-265c287aedd4 tempest-CreateVolumesFromImageTest-693658154 None] Lock "cinder-a94a7ba5-1626-4d74-a278-285cc49e6ba9-delete_volume" released by "delete_volume" :: held 3.475s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:56 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4cdb1bc6-9993-40ef-8416-5e55c2df32f9 tempest-CreateVolumesFromImageTest-693658154 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-40bf7dbf-b8e9-4851-9106-f455a928597e" returned: 0 in 1.242s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4cdb1bc6-9993-40ef-8416-5e55c2df32f9 tempest-CreateVolumesFromImageTest-693658154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-40bf7dbf-b8e9-4851-9106-f455a928597e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:56 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-40bf7dbf-b8e9-4851-9106-f455a928597e Feb 27 12:36:56 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:56 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-3e1790ea-2934-42a8-a204-5ccfa2f6946b" returned: 0 in 2.626s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:56 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbb0265-706d-4269-8019-c3a6f68d6932]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:56 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067 Feb 27 12:36:56 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:56 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4cdb1bc6-9993-40ef-8416-5e55c2df32f9 tempest-CreateVolumesFromImageTest-693658154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-40bf7dbf-b8e9-4851-9106-f455a928597e" returned: 0 in 0.466s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:56 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4cdb1bc6-9993-40ef-8416-5e55c2df32f9 tempest-CreateVolumesFromImageTest-693658154 None] Lock "cinder-quobyte-40bf7dbf-b8e9-4851-9106-f455a928597e" released by "delete_volume" :: held 1.756s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:56 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:56 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Flow 'volume_create_manager' (9951df84-d350-4abf-b528-c45b17da74ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:56 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ac6447-8a40-4f29-94f0-0b9a4909a7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:56 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ac6447-8a40-4f29-94f0-0b9a4909a7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-831623058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d449917-5611-408e-b78a-2cb05176464b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='753a25cc6bb14a91a623392f881af00b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:57Z,use_quota=True,user_id='bacda750039d46e49bcfd937d1055b4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:56 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467f68ea-40da-40c0-82fe-ce38bb849388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:56 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467f68ea-40da-40c0-82fe-ce38bb849388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:56 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34698764-518e-48de-a66b-3244db5d9f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:56 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34698764-518e-48de-a66b-3244db5d9f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d449917-5611-408e-b78a-2cb05176464b', 'volume_name': 'volume-5d449917-5611-408e-b78a-2cb05176464b', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:56 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb09765-0dbb-49f5-aad8-5939664b00f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:56 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb09765-0dbb-49f5-aad8-5939664b00f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:56 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab6222d-8df0-44c1-852e-033e8884056a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:56 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Volume 5d449917-5611-408e-b78a-2cb05176464b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d449917-5611-408e-b78a-2cb05176464b', 'volume_size': 1} Feb 27 12:36:56 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:56 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-4cdb1bc6-9993-40ef-8416-5e55c2df32f9 tempest-CreateVolumesFromImageTest-693658154 None] Created reservations ['37aaff57-3208-4386-8ef1-16f75d233a91', '0938d17e-d749-4638-8174-bc2783f86123', 'c9b85669-c405-4e63-9b9d-5709ac0c88cb', '0e1f502d-2bd2-4593-a61c-0785c65b8250'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-4cdb1bc6-9993-40ef-8416-5e55c2df32f9 tempest-CreateVolumesFromImageTest-693658154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-4cdb1bc6-9993-40ef-8416-5e55c2df32f9 tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-4cdb1bc6-9993-40ef-8416-5e55c2df32f9 tempest-CreateVolumesFromImageTest-693658154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-4cdb1bc6-9993-40ef-8416-5e55c2df32f9 tempest-CreateVolumesFromImageTest-693658154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-4cdb1bc6-9993-40ef-8416-5e55c2df32f9 tempest-CreateVolumesFromImageTest-693658154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4cdb1bc6-9993-40ef-8416-5e55c2df32f9 tempest-CreateVolumesFromImageTest-693658154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:57 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:36:57 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:57 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067" returned: 0 in 0.606s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Image conversion details: src /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067, size 1024.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-3e1790ea-2934-42a8-a204-5ccfa2f6946b {{(pid=83077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:36:57 devstack cinder-volume[83077]: INFO cinder.image.image_utils [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Converted 1024.00 MB image at 389.80 MB/s Feb 27 12:36:57 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-3e1790ea-2934-42a8-a204-5ccfa2f6946b is being set with open permissions: ugo+rw Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-3e1790ea-2934-42a8-a204-5ccfa2f6946b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:57 devstack sudo[90671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-3e1790ea-2934-42a8-a204-5ccfa2f6946b Feb 27 12:36:57 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:57 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-4cdb1bc6-9993-40ef-8416-5e55c2df32f9 tempest-CreateVolumesFromImageTest-693658154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.429s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-4cdb1bc6-9993-40ef-8416-5e55c2df32f9 tempest-CreateVolumesFromImageTest-693658154 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:36:57 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-4cdb1bc6-9993-40ef-8416-5e55c2df32f9 tempest-CreateVolumesFromImageTest-693658154 None] Deleted volume successfully. Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-4cdb1bc6-9993-40ef-8416-5e55c2df32f9 tempest-CreateVolumesFromImageTest-693658154 None] Lock "cinder-40bf7dbf-b8e9-4851-9106-f455a928597e-delete_volume" released by "delete_volume" :: held 2.551s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:57 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-3e1790ea-2934-42a8-a204-5ccfa2f6946b" returned: 0 in 0.421s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Lock "cinder-quobyte-3e1790ea-2934-42a8-a204-5ccfa2f6946b" released by "_copy_volume_from_snapshot" :: held 5.198s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Lock "cinder-quobyte-a7fef6a4-046c-4928-af04-aa7f68915f57-3e1790ea-2934-42a8-a204-5ccfa2f6946b" released by "_create_volume_from_snapshot" :: held 5.228s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.241s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.553s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1227534782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2733f4-f9bf-43cf-903a-4923b40ac319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611acbb00419421888588878a8dc6eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:54Z,use_quota=True,user_id='8277f83c35ad40fab7ecbb0079e53f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Creating volume fb2733f4-f9bf-43cf-903a-4923b40ac319 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:36:57 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fb2733f4-f9bf-43cf-903a-4923b40ac319 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:57 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fb2733f4-f9bf-43cf-903a-4923b40ac319 1073741824 Feb 27 12:36:57 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1f9ff2-ef4a-473d-8154-2222d4ff46ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e1790ea-2934-42a8-a204-5ccfa2f6946b', 'volume_size': 1, 'snapshot_id': 'a7fef6a4-046c-4928-af04-aa7f68915f57'}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed52ef80-ae39-4ea1-800c-8168ddc66bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:57 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Volume volume-3e1790ea-2934-42a8-a204-5ccfa2f6946b (3e1790ea-2934-42a8-a204-5ccfa2f6946b): created successfully Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed52ef80-ae39-4ea1-800c-8168ddc66bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Flow 'volume_create_manager' (7190deea-f76a-4c43-a335-4c4f5915557a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:57 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-f51df7b5-402b-4009-b0bc-8020063fc53e tempest-VolumeDependencyTests-56553957 None] Created volume successfully. Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1a895345-c0fa-4e04-8a21-1ba9e2977e3f tempest-VolumeDependencyTests-56553957 None] Acquiring lock "cinder-a7fef6a4-046c-4928-af04-aa7f68915f57-delete_snapshot" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1a895345-c0fa-4e04-8a21-1ba9e2977e3f tempest-VolumeDependencyTests-56553957 None] Lock "cinder-a7fef6a4-046c-4928-af04-aa7f68915f57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1a895345-c0fa-4e04-8a21-1ba9e2977e3f tempest-VolumeDependencyTests-56553957 None] Acquiring lock "cinder-quobyte-1dbdcd38-2d7a-4a06-8eac-e51c62e38067" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1a895345-c0fa-4e04-8a21-1ba9e2977e3f tempest-VolumeDependencyTests-56553957 None] Lock "cinder-quobyte-1dbdcd38-2d7a-4a06-8eac-e51c62e38067" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1a895345-c0fa-4e04-8a21-1ba9e2977e3f tempest-VolumeDependencyTests-56553957 None] Acquiring lock "cinder-quobyte-a7fef6a4-046c-4928-af04-aa7f68915f57" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1a895345-c0fa-4e04-8a21-1ba9e2977e3f tempest-VolumeDependencyTests-56553957 None] Lock "cinder-quobyte-a7fef6a4-046c-4928-af04-aa7f68915f57" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-1a895345-c0fa-4e04-8a21-1ba9e2977e3f tempest-VolumeDependencyTests-56553957 None] Deleting offline snapshot a7fef6a4-046c-4928-af04-aa7f68915f57 of volume 1dbdcd38-2d7a-4a06-8eac-e51c62e38067 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-1a895345-c0fa-4e04-8a21-1ba9e2977e3f tempest-VolumeDependencyTests-56553957 None] snapshot_file for this snap is: volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.a7fef6a4-046c-4928-af04-aa7f68915f57 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ceeac9-591e-426e-9be3-e438dfe5cb22]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:57 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1a895345-c0fa-4e04-8a21-1ba9e2977e3f tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.a7fef6a4-046c-4928-af04-aa7f68915f57 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:57 devstack sudo[90677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.a7fef6a4-046c-4928-af04-aa7f68915f57 Feb 27 12:36:57 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:58 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fb2733f4-f9bf-43cf-903a-4923b40ac319 1073741824" returned: 0 in 0.564s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fb2733f4-f9bf-43cf-903a-4923b40ac319 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:58 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fb2733f4-f9bf-43cf-903a-4923b40ac319 Feb 27 12:36:58 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:58 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1a895345-c0fa-4e04-8a21-1ba9e2977e3f tempest-VolumeDependencyTests-56553957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.a7fef6a4-046c-4928-af04-aa7f68915f57" returned: 0 in 0.592s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-1a895345-c0fa-4e04-8a21-1ba9e2977e3f tempest-VolumeDependencyTests-56553957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82646f5-64ee-4fd9-9287-7d4bc64daed0]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1a895345-c0fa-4e04-8a21-1ba9e2977e3f tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG oslo_service.periodic_task [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83077) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:58 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067 Feb 27 12:36:58 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:58 devstack sudo[90689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:36:58 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:58 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fb2733f4-f9bf-43cf-903a-4923b40ac319" returned: 0 in 0.441s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.365s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1509414122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c93b172e-5f21-41df-82c6-500b27540966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611acbb00419421888588878a8dc6eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:54Z,use_quota=True,user_id='8277f83c35ad40fab7ecbb0079e53f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Creating volume c93b172e-5f21-41df-82c6-500b27540966 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:36:58 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c93b172e-5f21-41df-82c6-500b27540966 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07626365-be58-4f50-955b-1bf71c85802f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb2733f4-f9bf-43cf-903a-4923b40ac319', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21e08c2-1a45-4abe-b99d-32ae63d35c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:58 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c93b172e-5f21-41df-82c6-500b27540966 1073741824 Feb 27 12:36:58 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:58 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Volume volume-fb2733f4-f9bf-43cf-903a-4923b40ac319 (fb2733f4-f9bf-43cf-903a-4923b40ac319): created successfully Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21e08c2-1a45-4abe-b99d-32ae63d35c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Flow 'volume_create_manager' (68f8d4ab-857c-4496-9b57-e4c8e1cb5c0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:58 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-a62adc1e-d8e4-48da-9fa2-4b9a2c1f9825 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Created volume successfully. Feb 27 12:36:58 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1a895345-c0fa-4e04-8a21-1ba9e2977e3f tempest-VolumeDependencyTests-56553957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067" returned: 0 in 0.499s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1a895345-c0fa-4e04-8a21-1ba9e2977e3f tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.a7fef6a4-046c-4928-af04-aa7f68915f57 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:58 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.a7fef6a4-046c-4928-af04-aa7f68915f57 Feb 27 12:36:58 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:58 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Flow 'volume_create_manager' (eaebe573-e3ae-4cc3-9313-f1d5ad3cc7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:59 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21cbe2ab-7921-4f68-bc98-3b236a1f23c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.502s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-7f5424e0-d4a2-48e0-b69e-4bd8d10066af None None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21cbe2ab-7921-4f68-bc98-3b236a1f23c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1302771841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6efa597b-1327-4241-b7c8-c58576a3ae6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82718824221d4344b57d7a60a171bf6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:59Z,use_quota=True,user_id='207500f72ac747979e07efe5c4ad4dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe837b0-c821-4d17-9588-35f0e85162e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe837b0-c821-4d17-9588-35f0e85162e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14355190-018e-4112-90e3-9033669dcd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14355190-018e-4112-90e3-9033669dcd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6efa597b-1327-4241-b7c8-c58576a3ae6d', 'volume_name': 'volume-6efa597b-1327-4241-b7c8-c58576a3ae6d', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d0f7eaf-36ba-4160-a1ae-0f557fa7f6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d0f7eaf-36ba-4160-a1ae-0f557fa7f6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (914c6bdd-6a09-47dd-91fd-6a964a190551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:59 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Volume 6efa597b-1327-4241-b7c8-c58576a3ae6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6efa597b-1327-4241-b7c8-c58576a3ae6d', 'volume_size': 1} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:59 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c93b172e-5f21-41df-82c6-500b27540966 1073741824" returned: 0 in 0.660s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c93b172e-5f21-41df-82c6-500b27540966 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:59 devstack sudo[90703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c93b172e-5f21-41df-82c6-500b27540966 Feb 27 12:36:59 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:59 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1a895345-c0fa-4e04-8a21-1ba9e2977e3f tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.a7fef6a4-046c-4928-af04-aa7f68915f57" returned: 0 in 0.478s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1a895345-c0fa-4e04-8a21-1ba9e2977e3f tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.a7fef6a4-046c-4928-af04-aa7f68915f57 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:59 devstack sudo[90708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.a7fef6a4-046c-4928-af04-aa7f68915f57 Feb 27 12:36:59 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:59 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c93b172e-5f21-41df-82c6-500b27540966" returned: 0 in 0.380s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.283s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-734397956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c95072e1-f1c5-42c3-9435-1942edcd3983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611acbb00419421888588878a8dc6eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:54Z,use_quota=True,user_id='8277f83c35ad40fab7ecbb0079e53f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Creating volume c95072e1-f1c5-42c3-9435-1942edcd3983 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:36:59 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c95072e1-f1c5-42c3-9435-1942edcd3983 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:59 devstack sudo[90711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c95072e1-f1c5-42c3-9435-1942edcd3983 1073741824 Feb 27 12:36:59 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa7ada9-6f9d-450b-b6fa-6c80c1edf223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c93b172e-5f21-41df-82c6-500b27540966', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f24800-3a9b-4447-bdef-3c3ae89fdd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:59 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Volume volume-c93b172e-5f21-41df-82c6-500b27540966 (c93b172e-5f21-41df-82c6-500b27540966): created successfully Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f24800-3a9b-4447-bdef-3c3ae89fdd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Flow 'volume_create_manager' (1d3d1c6f-9ca4-4afb-92de-4716512f1749) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:59 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-8aa629f3-89be-49fc-a898-4f050b73cb18 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Created volume successfully. Feb 27 12:36:59 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1a895345-c0fa-4e04-8a21-1ba9e2977e3f tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067.a7fef6a4-046c-4928-af04-aa7f68915f57" returned: 0 in 0.400s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1a895345-c0fa-4e04-8a21-1ba9e2977e3f tempest-VolumeDependencyTests-56553957 None] Lock "cinder-quobyte-a7fef6a4-046c-4928-af04-aa7f68915f57" released by "_delete_snapshot" :: held 2.025s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1a895345-c0fa-4e04-8a21-1ba9e2977e3f tempest-VolumeDependencyTests-56553957 None] Lock "cinder-quobyte-1dbdcd38-2d7a-4a06-8eac-e51c62e38067" released by "delete_snapshot" :: held 2.035s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-1a895345-c0fa-4e04-8a21-1ba9e2977e3f tempest-VolumeDependencyTests-56553957 None] Created reservations ['9dc5d513-fc62-4f11-b793-c8b59f337b1f', '38770b31-9595-4838-84c7-fc843dad6b85', 'd21dfebc-2f20-4d95-b98e-21638c1bb5b5', '85a78dc6-6ae7-46e6-9158-f6e9b9f6a47f'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:36:59 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-1a895345-c0fa-4e04-8a21-1ba9e2977e3f tempest-VolumeDependencyTests-56553957 None] Delete snapshot completed successfully. Feb 27 12:36:59 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1a895345-c0fa-4e04-8a21-1ba9e2977e3f tempest-VolumeDependencyTests-56553957 None] Lock "cinder-a7fef6a4-046c-4928-af04-aa7f68915f57-delete_snapshot" released by "delete_snapshot" :: held 2.134s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:00 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c95072e1-f1c5-42c3-9435-1942edcd3983 1073741824" returned: 0 in 0.496s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c95072e1-f1c5-42c3-9435-1942edcd3983 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:00 devstack sudo[90717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c95072e1-f1c5-42c3-9435-1942edcd3983 Feb 27 12:37:00 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:00 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c95072e1-f1c5-42c3-9435-1942edcd3983" returned: 0 in 0.445s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:00 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:37:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.034s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:00 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-459583007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=490313ac-b708-47fe-b5e7-6b0a3bb316df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611acbb00419421888588878a8dc6eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:54Z,use_quota=True,user_id='8277f83c35ad40fab7ecbb0079e53f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:37:00 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Creating volume 490313ac-b708-47fe-b5e7-6b0a3bb316df {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:37:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:00 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:00 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:00 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:37:00 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:37:00 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-490313ac-b708-47fe-b5e7-6b0a3bb316df 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:00 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (028cb643-e12b-402a-b22a-257b6b7fe8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c95072e1-f1c5-42c3-9435-1942edcd3983', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:00 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b509d0e6-07b4-49ad-b262-6ec45d76d437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:00 devstack sudo[90720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-490313ac-b708-47fe-b5e7-6b0a3bb316df 1073741824 Feb 27 12:37:00 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:00 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Volume volume-c95072e1-f1c5-42c3-9435-1942edcd3983 (c95072e1-f1c5-42c3-9435-1942edcd3983): created successfully Feb 27 12:37:00 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b509d0e6-07b4-49ad-b262-6ec45d76d437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:00 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Flow 'volume_create_manager' (d0902234-4c34-469d-aef3-daefb870f5ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:00 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-80376cf4-8b61-443c-a6a1-3e81184a0fc0 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Created volume successfully. Feb 27 12:37:00 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-9e33f482-7214-4e66-bace-998fc133590d tempest-VolumeDependencyTests-56553957 None] Acquiring lock "cinder-1dbdcd38-2d7a-4a06-8eac-e51c62e38067-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-9e33f482-7214-4e66-bace-998fc133590d tempest-VolumeDependencyTests-56553957 None] Lock "cinder-1dbdcd38-2d7a-4a06-8eac-e51c62e38067-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-9e33f482-7214-4e66-bace-998fc133590d tempest-VolumeDependencyTests-56553957 None] Acquiring lock "cinder-quobyte-1dbdcd38-2d7a-4a06-8eac-e51c62e38067" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-9e33f482-7214-4e66-bace-998fc133590d tempest-VolumeDependencyTests-56553957 None] Lock "cinder-quobyte-1dbdcd38-2d7a-4a06-8eac-e51c62e38067" acquired by "delete_volume" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb31cbf-800e-44c3-aafb-ca4182f4f093]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9e33f482-7214-4e66-bace-998fc133590d tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:01 devstack sudo[90726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067 Feb 27 12:37:01 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:01 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-490313ac-b708-47fe-b5e7-6b0a3bb316df 1073741824" returned: 0 in 0.526s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-490313ac-b708-47fe-b5e7-6b0a3bb316df {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:01 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-490313ac-b708-47fe-b5e7-6b0a3bb316df Feb 27 12:37:01 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:01 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9e33f482-7214-4e66-bace-998fc133590d tempest-VolumeDependencyTests-56553957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067" returned: 0 in 0.450s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9e33f482-7214-4e66-bace-998fc133590d tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:01 devstack sudo[90734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067 Feb 27 12:37:01 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:01 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-490313ac-b708-47fe-b5e7-6b0a3bb316df" returned: 0 in 0.398s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.956s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1022831174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59213351-9eb4-4ab2-bafe-d01a0002884c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611acbb00419421888588878a8dc6eed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:54Z,use_quota=True,user_id='8277f83c35ad40fab7ecbb0079e53f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Creating volume 59213351-9eb4-4ab2-bafe-d01a0002884c {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:37:01 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-59213351-9eb4-4ab2-bafe-d01a0002884c 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f4b2eb-aa46-4dc0-a877-0691635f50af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-490313ac-b708-47fe-b5e7-6b0a3bb316df', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:01 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-59213351-9eb4-4ab2-bafe-d01a0002884c 1073741824 Feb 27 12:37:01 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ac00be-02e6-41ea-9019-cef7c1f0d95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:01 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Volume volume-490313ac-b708-47fe-b5e7-6b0a3bb316df (490313ac-b708-47fe-b5e7-6b0a3bb316df): created successfully Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ac00be-02e6-41ea-9019-cef7c1f0d95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Flow 'volume_create_manager' (28d3d6be-acfc-4954-b29f-96e4e88538d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:01 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-03dcbbf8-cb0d-4cc8-a8af-331273f06fd8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Created volume successfully. Feb 27 12:37:01 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9e33f482-7214-4e66-bace-998fc133590d tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1dbdcd38-2d7a-4a06-8eac-e51c62e38067" returned: 0 in 0.392s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-9e33f482-7214-4e66-bace-998fc133590d tempest-VolumeDependencyTests-56553957 None] Lock "cinder-quobyte-1dbdcd38-2d7a-4a06-8eac-e51c62e38067" released by "delete_volume" :: held 0.875s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:01 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-9e33f482-7214-4e66-bace-998fc133590d tempest-VolumeDependencyTests-56553957 None] Created reservations ['8bca2cd8-ec53-4693-bc84-043a5885be54', '0053ca6d-ffa7-4b7d-951c-adb9127fbd9a', 'c0092f9f-84e4-466b-aefc-2302e720da0f', 'e24f2ae1-e3f2-4fd3-8d38-755b6ff7e283'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-9e33f482-7214-4e66-bace-998fc133590d tempest-VolumeDependencyTests-56553957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-9e33f482-7214-4e66-bace-998fc133590d tempest-VolumeDependencyTests-56553957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-9e33f482-7214-4e66-bace-998fc133590d tempest-VolumeDependencyTests-56553957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-9e33f482-7214-4e66-bace-998fc133590d tempest-VolumeDependencyTests-56553957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-9e33f482-7214-4e66-bace-998fc133590d tempest-VolumeDependencyTests-56553957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9e33f482-7214-4e66-bace-998fc133590d tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:02 devstack sudo[90744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:37:02 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:02 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-59213351-9eb4-4ab2-bafe-d01a0002884c 1073741824" returned: 0 in 0.530s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-59213351-9eb4-4ab2-bafe-d01a0002884c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:02 devstack sudo[90746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-59213351-9eb4-4ab2-bafe-d01a0002884c Feb 27 12:37:02 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Flow 'volume_create_manager' (b5806988-b7d9-439d-8155-b5d103188e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb0cf3e-7fce-4a76-b6a2-5e90d310c670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb0cf3e-7fce-4a76-b6a2-5e90d310c670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1902207107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5208ddcf-6e19-4768-8228-22eb39cba324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d4990b860b4747be7eb280e4cbced9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:02Z,use_quota=True,user_id='722b2a83f0c94b8aa1b9d295a6ad696e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b69e18f-3d5e-4918-8cd1-7c0c7a1eb5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b69e18f-3d5e-4918-8cd1-7c0c7a1eb5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0538a212-e89e-46fb-a68a-d401b76feb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0538a212-e89e-46fb-a68a-d401b76feb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5208ddcf-6e19-4768-8228-22eb39cba324', 'volume_name': 'volume-5208ddcf-6e19-4768-8228-22eb39cba324', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c50da1-aacd-481c-8fa5-e639fb784dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c50da1-aacd-481c-8fa5-e639fb784dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62120e0d-9def-43b7-885e-67f5a94505ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:02 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Volume 5208ddcf-6e19-4768-8228-22eb39cba324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5208ddcf-6e19-4768-8228-22eb39cba324', 'volume_size': 1} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:02 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-9e33f482-7214-4e66-bace-998fc133590d tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.409s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-9e33f482-7214-4e66-bace-998fc133590d tempest-VolumeDependencyTests-56553957 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:02 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-9e33f482-7214-4e66-bace-998fc133590d tempest-VolumeDependencyTests-56553957 None] Deleted volume successfully. Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-9e33f482-7214-4e66-bace-998fc133590d tempest-VolumeDependencyTests-56553957 None] Lock "cinder-1dbdcd38-2d7a-4a06-8eac-e51c62e38067-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:02 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-59213351-9eb4-4ab2-bafe-d01a0002884c" returned: 0 in 0.508s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.719s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-831623058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d449917-5611-408e-b78a-2cb05176464b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='753a25cc6bb14a91a623392f881af00b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:57Z,use_quota=True,user_id='bacda750039d46e49bcfd937d1055b4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Creating volume 5d449917-5611-408e-b78a-2cb05176464b {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:37:02 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d548270-bb71-42ab-ad8b-0cf5039fa904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59213351-9eb4-4ab2-bafe-d01a0002884c', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9318df-828a-495b-b330-0d3c7c5f076e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:02 devstack sudo[90750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b 1073741824 Feb 27 12:37:02 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:02 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Volume volume-59213351-9eb4-4ab2-bafe-d01a0002884c (59213351-9eb4-4ab2-bafe-d01a0002884c): created successfully Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9318df-828a-495b-b330-0d3c7c5f076e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:02 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Flow 'volume_create_manager' (a2651286-fd83-428d-9cdc-e665b51a38da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:02 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-e4d01e29-4423-484b-8992-0ef94b2caf1a tempest-CreateVolumesFromSnapshotTest-1457396782 None] Created volume successfully. Feb 27 12:37:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-0e085fff-8231-4fbc-804f-4696f776c0f6 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "cinder-490313ac-b708-47fe-b5e7-6b0a3bb316df-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-0e085fff-8231-4fbc-804f-4696f776c0f6 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-490313ac-b708-47fe-b5e7-6b0a3bb316df-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-0e085fff-8231-4fbc-804f-4696f776c0f6 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "cinder-quobyte-490313ac-b708-47fe-b5e7-6b0a3bb316df" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:03 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-0e085fff-8231-4fbc-804f-4696f776c0f6 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-quobyte-490313ac-b708-47fe-b5e7-6b0a3bb316df" acquired by "delete_volume" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:03 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[85385518-92b1-42fb-9bac-58596fee6dbf]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0e085fff-8231-4fbc-804f-4696f776c0f6 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-490313ac-b708-47fe-b5e7-6b0a3bb316df {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:03 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b 1073741824" returned: 0 in 0.532s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:03 devstack sudo[90756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b Feb 27 12:37:03 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:03 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-490313ac-b708-47fe-b5e7-6b0a3bb316df Feb 27 12:37:03 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:03 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b" returned: 0 in 0.388s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:03 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:37:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.571s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:03 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1302771841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6efa597b-1327-4241-b7c8-c58576a3ae6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82718824221d4344b57d7a60a171bf6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:59Z,use_quota=True,user_id='207500f72ac747979e07efe5c4ad4dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:37:03 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Creating volume 6efa597b-1327-4241-b7c8-c58576a3ae6d {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:37:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:03 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:03 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:03 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:37:03 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:37:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6efa597b-1327-4241-b7c8-c58576a3ae6d 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:03 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0e085fff-8231-4fbc-804f-4696f776c0f6 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-490313ac-b708-47fe-b5e7-6b0a3bb316df" returned: 0 in 0.470s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:03 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0e085fff-8231-4fbc-804f-4696f776c0f6 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-490313ac-b708-47fe-b5e7-6b0a3bb316df {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:03 devstack sudo[90763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6efa597b-1327-4241-b7c8-c58576a3ae6d 1073741824 Feb 27 12:37:03 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:03 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab6222d-8df0-44c1-852e-033e8884056a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d449917-5611-408e-b78a-2cb05176464b', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:03 devstack sudo[90765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-490313ac-b708-47fe-b5e7-6b0a3bb316df Feb 27 12:37:03 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:03 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06362dd-8cf3-4b46-ba5d-5b39ea92506d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:03 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Volume volume-5d449917-5611-408e-b78a-2cb05176464b (5d449917-5611-408e-b78a-2cb05176464b): created successfully Feb 27 12:37:03 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06362dd-8cf3-4b46-ba5d-5b39ea92506d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:03 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Flow 'volume_create_manager' (9951df84-d350-4abf-b528-c45b17da74ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:03 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-dcaec543-60d6-439c-bf09-4b4fdc53e55e tempest-SnapshotDependencyTests-1810568490 None] Created volume successfully. Feb 27 12:37:04 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0e085fff-8231-4fbc-804f-4696f776c0f6 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-490313ac-b708-47fe-b5e7-6b0a3bb316df" returned: 0 in 0.376s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-0e085fff-8231-4fbc-804f-4696f776c0f6 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-quobyte-490313ac-b708-47fe-b5e7-6b0a3bb316df" released by "delete_volume" :: held 0.892s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-0e085fff-8231-4fbc-804f-4696f776c0f6 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Created reservations ['3ac0e125-20b0-441c-8482-b032181de08a', '1eb74fb2-45cc-4840-a4f3-5332dc3c46ad', '91948916-ed87-4a91-9bb4-5c1231983f39', '797b4cea-8ea8-48d0-8f10-f01f8e93ee4c'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0e085fff-8231-4fbc-804f-4696f776c0f6 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0e085fff-8231-4fbc-804f-4696f776c0f6 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:04 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0e085fff-8231-4fbc-804f-4696f776c0f6 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0e085fff-8231-4fbc-804f-4696f776c0f6 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0e085fff-8231-4fbc-804f-4696f776c0f6 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0e085fff-8231-4fbc-804f-4696f776c0f6 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6efa597b-1327-4241-b7c8-c58576a3ae6d 1073741824" returned: 0 in 0.490s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:04 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:37:04 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6efa597b-1327-4241-b7c8-c58576a3ae6d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:04 devstack sudo[90773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6efa597b-1327-4241-b7c8-c58576a3ae6d Feb 27 12:37:04 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-599ace94-649c-4457-80f6-51e3fcf9f611 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "cinder-59213351-9eb4-4ab2-bafe-d01a0002884c-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-599ace94-649c-4457-80f6-51e3fcf9f611 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-59213351-9eb4-4ab2-bafe-d01a0002884c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-599ace94-649c-4457-80f6-51e3fcf9f611 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "cinder-quobyte-59213351-9eb4-4ab2-bafe-d01a0002884c" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-599ace94-649c-4457-80f6-51e3fcf9f611 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-quobyte-59213351-9eb4-4ab2-bafe-d01a0002884c" acquired by "delete_volume" :: waited 0.013s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d428e19-43d7-4373-aaaa-476608cb378f]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-599ace94-649c-4457-80f6-51e3fcf9f611 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-59213351-9eb4-4ab2-bafe-d01a0002884c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:04 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-59213351-9eb4-4ab2-bafe-d01a0002884c Feb 27 12:37:04 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2766da63-6cd3-4da9-bdee-855d9b6973a5 tempest-SnapshotDependencyTests-1810568490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:04 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0e085fff-8231-4fbc-804f-4696f776c0f6 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.435s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-0e085fff-8231-4fbc-804f-4696f776c0f6 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:04 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-0e085fff-8231-4fbc-804f-4696f776c0f6 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Deleted volume successfully. Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-0e085fff-8231-4fbc-804f-4696f776c0f6 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-490313ac-b708-47fe-b5e7-6b0a3bb316df-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:04 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6efa597b-1327-4241-b7c8-c58576a3ae6d" returned: 0 in 0.482s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.228s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1902207107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5208ddcf-6e19-4768-8228-22eb39cba324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d4990b860b4747be7eb280e4cbced9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:02Z,use_quota=True,user_id='722b2a83f0c94b8aa1b9d295a6ad696e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Creating volume 5208ddcf-6e19-4768-8228-22eb39cba324 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:37:04 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:04 devstack sudo[90779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324 1073741824 Feb 27 12:37:04 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (914c6bdd-6a09-47dd-91fd-6a964a190551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6efa597b-1327-4241-b7c8-c58576a3ae6d', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b62b7dc9-8ec2-4ff6-b763-6feeb1b13de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:04 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Volume volume-6efa597b-1327-4241-b7c8-c58576a3ae6d (6efa597b-1327-4241-b7c8-c58576a3ae6d): created successfully Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b62b7dc9-8ec2-4ff6-b763-6feeb1b13de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Flow 'volume_create_manager' (eaebe573-e3ae-4cc3-9313-f1d5ad3cc7e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:04 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-67ddd1aa-a3f8-4a59-9a40-64c34f83a44a tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Created volume successfully. Feb 27 12:37:04 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-599ace94-649c-4457-80f6-51e3fcf9f611 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-59213351-9eb4-4ab2-bafe-d01a0002884c" returned: 0 in 0.519s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:04 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-599ace94-649c-4457-80f6-51e3fcf9f611 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-59213351-9eb4-4ab2-bafe-d01a0002884c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:04 devstack sudo[90784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-59213351-9eb4-4ab2-bafe-d01a0002884c Feb 27 12:37:04 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:05 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324 1073741824" returned: 0 in 0.441s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:05 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324 Feb 27 12:37:05 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:05 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-599ace94-649c-4457-80f6-51e3fcf9f611 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-59213351-9eb4-4ab2-bafe-d01a0002884c" returned: 0 in 0.425s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-599ace94-649c-4457-80f6-51e3fcf9f611 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-quobyte-59213351-9eb4-4ab2-bafe-d01a0002884c" released by "delete_volume" :: held 0.984s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-599ace94-649c-4457-80f6-51e3fcf9f611 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Created reservations ['e3a50813-fb3b-47a4-bb5d-8dc7e9a6c037', 'b96f9743-537c-42b6-ad80-ba3cf747bde5', '7ad5d914-1463-442a-8253-3f308b5c8af8', '88a556f9-bcf5-403f-b0e9-e6b11eda16b1'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-599ace94-649c-4457-80f6-51e3fcf9f611 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-599ace94-649c-4457-80f6-51e3fcf9f611 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-599ace94-649c-4457-80f6-51e3fcf9f611 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-599ace94-649c-4457-80f6-51e3fcf9f611 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-599ace94-649c-4457-80f6-51e3fcf9f611 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-599ace94-649c-4457-80f6-51e3fcf9f611 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:05 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:37:05 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:05 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Flow 'volume_create_manager' (df8ef9bf-a6d5-4efc-ab48-2f68ab15a573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16101f1b-45dd-44d5-8519-72e71bb5da0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16101f1b-45dd-44d5-8519-72e71bb5da0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1804664856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca6c17f-74a8-4a06-bd59-97f9d1e1012e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82718824221d4344b57d7a60a171bf6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:06Z,use_quota=True,user_id='207500f72ac747979e07efe5c4ad4dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b46d8c-c161-4a4e-baa8-cb1cb4512157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b46d8c-c161-4a4e-baa8-cb1cb4512157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e89e38c-936c-43fc-8b86-6b85f467e6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e89e38c-936c-43fc-8b86-6b85f467e6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ca6c17f-74a8-4a06-bd59-97f9d1e1012e', 'volume_name': 'volume-7ca6c17f-74a8-4a06-bd59-97f9d1e1012e', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bb9a361-967c-4324-99bf-c1ae7a649aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bb9a361-967c-4324-99bf-c1ae7a649aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f51460-60df-4f87-b32e-d3d21870440f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:05 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Volume 7ca6c17f-74a8-4a06-bd59-97f9d1e1012e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ca6c17f-74a8-4a06-bd59-97f9d1e1012e', 'volume_size': 1} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324" returned: 0 in 0.547s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2766da63-6cd3-4da9-bdee-855d9b6973a5 tempest-SnapshotDependencyTests-1810568490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.141s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-2766da63-6cd3-4da9-bdee-855d9b6973a5 tempest-SnapshotDependencyTests-1810568490 None] Creating offline snapshot d9f3b0f2-9e71-455c-908f-1c7e2149a0de of volume 5d449917-5611-408e-b78a-2cb05176464b {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62120e0d-9def-43b7-885e-67f5a94505ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5208ddcf-6e19-4768-8228-22eb39cba324', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4976b3cb-2618-44ff-b352-abdaa9681455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3d9bda-a8be-4cb7-b046-369f89eda506]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2766da63-6cd3-4da9-bdee-855d9b6973a5 tempest-SnapshotDependencyTests-1810568490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:05 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Volume volume-5208ddcf-6e19-4768-8228-22eb39cba324 (5208ddcf-6e19-4768-8228-22eb39cba324): created successfully Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4976b3cb-2618-44ff-b352-abdaa9681455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Flow 'volume_create_manager' (b5806988-b7d9-439d-8155-b5d103188e35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:05 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-7abd2d0b-39f1-416d-8e00-c6b4d05ca7af tempest-VolumeDependencyTests-56553957 None] Created volume successfully. Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:37:05 devstack sudo[90795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b Feb 27 12:37:05 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Flow 'volume_create_manager' (97f7544d-5bee-434a-bbb2-e35c7b715624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3c2cd9-99a2-4fda-849a-a99f8e47658f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3c2cd9-99a2-4fda-849a-a99f8e47658f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-842048300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3224c6-062d-42b6-ad4a-786091a12b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82718824221d4344b57d7a60a171bf6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:06Z,use_quota=True,user_id='207500f72ac747979e07efe5c4ad4dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c538e4-7f9e-4eb7-ab4f-cf977e30a4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c538e4-7f9e-4eb7-ab4f-cf977e30a4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9ce709-5514-4ac1-b94f-dbb633425455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9ce709-5514-4ac1-b94f-dbb633425455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba3224c6-062d-42b6-ad4a-786091a12b0c', 'volume_name': 'volume-ba3224c6-062d-42b6-ad4a-786091a12b0c', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da14a7db-2c0e-47a7-a5a2-09a6dea5ab11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da14a7db-2c0e-47a7-a5a2-09a6dea5ab11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f865b4-bc0e-4caf-bdcb-8331234bdbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:05 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Volume ba3224c6-062d-42b6-ad4a-786091a12b0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba3224c6-062d-42b6-ad4a-786091a12b0c', 'volume_size': 1} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:05 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:37:06 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Flow 'volume_create_manager' (8aa9eb9d-eb6d-4dfc-b3de-4c173193185a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07452e5f-7192-4cd0-9135-499a015fc2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-599ace94-649c-4457-80f6-51e3fcf9f611 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.533s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-599ace94-649c-4457-80f6-51e3fcf9f611 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07452e5f-7192-4cd0-9135-499a015fc2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1231830945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54493047-15fa-4c44-9090-bf78df01d7f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82718824221d4344b57d7a60a171bf6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:06Z,use_quota=True,user_id='207500f72ac747979e07efe5c4ad4dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6cad202-72b8-4e0b-bfd9-c4541ba61402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6cad202-72b8-4e0b-bfd9-c4541ba61402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0bb45df-8ae4-4aec-85ce-da1fb7cf538a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0bb45df-8ae4-4aec-85ce-da1fb7cf538a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54493047-15fa-4c44-9090-bf78df01d7f4', 'volume_name': 'volume-54493047-15fa-4c44-9090-bf78df01d7f4', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f397cc0b-e526-4502-bfb9-ba3b4f2cea39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f397cc0b-e526-4502-bfb9-ba3b4f2cea39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7034bdc-4a90-4252-a606-4d7a741db4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:06 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Volume 54493047-15fa-4c44-9090-bf78df01d7f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54493047-15fa-4c44-9090-bf78df01d7f4', 'volume_size': 1} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:06 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-599ace94-649c-4457-80f6-51e3fcf9f611 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Deleted volume successfully. Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-599ace94-649c-4457-80f6-51e3fcf9f611 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-59213351-9eb4-4ab2-bafe-d01a0002884c-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:06 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2766da63-6cd3-4da9-bdee-855d9b6973a5 tempest-SnapshotDependencyTests-1810568490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b" returned: 0 in 0.559s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2766da63-6cd3-4da9-bdee-855d9b6973a5 tempest-SnapshotDependencyTests-1810568490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.d9f3b0f2-9e71-455c-908f-1c7e2149a0de 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:37:06 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.d9f3b0f2-9e71-455c-908f-1c7e2149a0de 1G Feb 27 12:37:06 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Flow 'volume_create_manager' (0bf04b56-1206-4a45-b3cb-4a181fd07be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d416d6-1dfe-4c6c-a96a-88a3079b6628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d416d6-1dfe-4c6c-a96a-88a3079b6628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-106460271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f14fb3-6245-44da-96ed-2bfe19bc68ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82718824221d4344b57d7a60a171bf6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:06Z,use_quota=True,user_id='207500f72ac747979e07efe5c4ad4dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (258602bc-b862-4984-8d8f-00db48b10d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (258602bc-b862-4984-8d8f-00db48b10d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9d25df-afd1-4cb0-9459-2f55417b8fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9d25df-afd1-4cb0-9459-2f55417b8fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48f14fb3-6245-44da-96ed-2bfe19bc68ec', 'volume_name': 'volume-48f14fb3-6245-44da-96ed-2bfe19bc68ec', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b442272-746e-4506-81f2-954675cc5a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b442272-746e-4506-81f2-954675cc5a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c70e970-eeca-4def-81e8-d8435ee65ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:06 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Volume 48f14fb3-6245-44da-96ed-2bfe19bc68ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48f14fb3-6245-44da-96ed-2bfe19bc68ec', 'volume_size': 1} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Flow 'volume_create_manager' (8f481c66-7f84-43f7-82e3-ba11ac4dae25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1108d99-2f83-4938-b8de-40d0c41f233b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1108d99-2f83-4938-b8de-40d0c41f233b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-353318740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d945698-4554-4f09-9ea4-00d56555b787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82718824221d4344b57d7a60a171bf6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:06Z,use_quota=True,user_id='207500f72ac747979e07efe5c4ad4dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (043ab238-26c8-4b89-81f2-7a63a87fe795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (043ab238-26c8-4b89-81f2-7a63a87fe795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d1e430-01e7-4643-a9cd-269c8423123c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d1e430-01e7-4643-a9cd-269c8423123c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d945698-4554-4f09-9ea4-00d56555b787', 'volume_name': 'volume-8d945698-4554-4f09-9ea4-00d56555b787', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd468c6-754e-4041-a7fb-41f525e0087c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd468c6-754e-4041-a7fb-41f525e0087c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (805860ca-89e2-4396-a922-32547647db23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:06 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Volume 8d945698-4554-4f09-9ea4-00d56555b787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d945698-4554-4f09-9ea4-00d56555b787', 'volume_size': 1} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31c01614-fdcb-466c-86ae-801ea5e054b8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "cinder-c95072e1-f1c5-42c3-9435-1942edcd3983-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31c01614-fdcb-466c-86ae-801ea5e054b8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-c95072e1-f1c5-42c3-9435-1942edcd3983-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31c01614-fdcb-466c-86ae-801ea5e054b8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "cinder-quobyte-c95072e1-f1c5-42c3-9435-1942edcd3983" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31c01614-fdcb-466c-86ae-801ea5e054b8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-quobyte-c95072e1-f1c5-42c3-9435-1942edcd3983" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcad4cb5-6a24-4ab4-a1a9-4b49463dda8c]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31c01614-fdcb-466c-86ae-801ea5e054b8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c95072e1-f1c5-42c3-9435-1942edcd3983 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:06 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c95072e1-f1c5-42c3-9435-1942edcd3983 Feb 27 12:37:06 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:06 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2766da63-6cd3-4da9-bdee-855d9b6973a5 tempest-SnapshotDependencyTests-1810568490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.d9f3b0f2-9e71-455c-908f-1c7e2149a0de 1G" returned: 0 in 0.500s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2766da63-6cd3-4da9-bdee-855d9b6973a5 tempest-SnapshotDependencyTests-1810568490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d449917-5611-408e-b78a-2cb05176464b -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.d9f3b0f2-9e71-455c-908f-1c7e2149a0de {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:06 devstack sudo[90808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d449917-5611-408e-b78a-2cb05176464b -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.d9f3b0f2-9e71-455c-908f-1c7e2149a0de Feb 27 12:37:06 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Flow 'volume_create_manager' (e4381726-3360-48d3-be8c-2cae247f9e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f84d0c4-cda0-4611-a84a-6e2bde546889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f84d0c4-cda0-4611-a84a-6e2bde546889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-610003774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d4990b860b4747be7eb280e4cbced9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=5208ddcf-6e19-4768-8228-22eb39cba324,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:07Z,use_quota=True,user_id='722b2a83f0c94b8aa1b9d295a6ad696e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed16986d-e9f8-4d90-a1ad-972069b41be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed16986d-e9f8-4d90-a1ad-972069b41be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c18fef10-86d4-417d-8961-2b63a248d341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c18fef10-86d4-417d-8961-2b63a248d341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4', 'volume_name': 'volume-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4', 'volume_size': 1, 'source_volid': '5208ddcf-6e19-4768-8228-22eb39cba324', 'source_volstatus': 'available'}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19845a6e-4393-440e-b360-37f982528797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19845a6e-4393-440e-b360-37f982528797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:06 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e5b1c4e-1277-4c37-bc0c-5515607fa182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:06 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Volume e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4', 'volume_size': 1, 'source_volid': '5208ddcf-6e19-4768-8228-22eb39cba324', 'source_volstatus': 'available'} Feb 27 12:37:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:07 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31c01614-fdcb-466c-86ae-801ea5e054b8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c95072e1-f1c5-42c3-9435-1942edcd3983" returned: 0 in 0.529s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31c01614-fdcb-466c-86ae-801ea5e054b8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c95072e1-f1c5-42c3-9435-1942edcd3983 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:07 devstack sudo[90815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c95072e1-f1c5-42c3-9435-1942edcd3983 Feb 27 12:37:07 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:07 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2766da63-6cd3-4da9-bdee-855d9b6973a5 tempest-SnapshotDependencyTests-1810568490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d449917-5611-408e-b78a-2cb05176464b -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.d9f3b0f2-9e71-455c-908f-1c7e2149a0de" returned: 0 in 0.434s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:07 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-2766da63-6cd3-4da9-bdee-855d9b6973a5 tempest-SnapshotDependencyTests-1810568490 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.d9f3b0f2-9e71-455c-908f-1c7e2149a0de is being set with open permissions: ugo+rw Feb 27 12:37:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2766da63-6cd3-4da9-bdee-855d9b6973a5 tempest-SnapshotDependencyTests-1810568490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.d9f3b0f2-9e71-455c-908f-1c7e2149a0de {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:07 devstack sudo[90818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.d9f3b0f2-9e71-455c-908f-1c7e2149a0de Feb 27 12:37:07 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:07 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31c01614-fdcb-466c-86ae-801ea5e054b8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c95072e1-f1c5-42c3-9435-1942edcd3983" returned: 0 in 0.393s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31c01614-fdcb-466c-86ae-801ea5e054b8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-quobyte-c95072e1-f1c5-42c3-9435-1942edcd3983" released by "delete_volume" :: held 0.957s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:07 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-31c01614-fdcb-466c-86ae-801ea5e054b8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Created reservations ['74635a27-dbb3-43b5-98b6-9b69f09c89db', '288606b9-7fff-4bf1-acf2-59aa54fc5ecf', '14841b5e-2997-45c7-901a-60a190667807', '0a2c17c1-9b09-4a3f-83da-98ccc3d99ec5'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-31c01614-fdcb-466c-86ae-801ea5e054b8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-31c01614-fdcb-466c-86ae-801ea5e054b8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:07 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-31c01614-fdcb-466c-86ae-801ea5e054b8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:07 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-31c01614-fdcb-466c-86ae-801ea5e054b8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-31c01614-fdcb-466c-86ae-801ea5e054b8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31c01614-fdcb-466c-86ae-801ea5e054b8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:07 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2766da63-6cd3-4da9-bdee-855d9b6973a5 tempest-SnapshotDependencyTests-1810568490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.d9f3b0f2-9e71-455c-908f-1c7e2149a0de" returned: 0 in 0.407s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:07 devstack sudo[90822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:37:07 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2766da63-6cd3-4da9-bdee-855d9b6973a5 tempest-SnapshotDependencyTests-1810568490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-63482a1f-606f-449c-a169-a415a8577f07 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "cinder-c93b172e-5f21-41df-82c6-500b27540966-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:07 devstack sudo[90824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.info Feb 27 12:37:07 devstack sudo[90824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-63482a1f-606f-449c-a169-a415a8577f07 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-c93b172e-5f21-41df-82c6-500b27540966-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-63482a1f-606f-449c-a169-a415a8577f07 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "cinder-quobyte-c93b172e-5f21-41df-82c6-500b27540966" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:07 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-63482a1f-606f-449c-a169-a415a8577f07 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-quobyte-c93b172e-5f21-41df-82c6-500b27540966" acquired by "delete_volume" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:07 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff8a3e7-c72f-4be2-994a-f1b7c97b5266]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-63482a1f-606f-449c-a169-a415a8577f07 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c93b172e-5f21-41df-82c6-500b27540966 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:07 devstack sudo[90826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c93b172e-5f21-41df-82c6-500b27540966 Feb 27 12:37:07 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:07 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:07 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-31c01614-fdcb-466c-86ae-801ea5e054b8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.403s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:07 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-31c01614-fdcb-466c-86ae-801ea5e054b8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:08 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-31c01614-fdcb-466c-86ae-801ea5e054b8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Deleted volume successfully. Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-31c01614-fdcb-466c-86ae-801ea5e054b8 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-c95072e1-f1c5-42c3-9435-1942edcd3983-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:08 devstack sudo[90824]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2766da63-6cd3-4da9-bdee-855d9b6973a5 tempest-SnapshotDependencyTests-1810568490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.info" returned: 0 in 0.419s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:08 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-2766da63-6cd3-4da9-bdee-855d9b6973a5 tempest-SnapshotDependencyTests-1810568490 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.info is being set with open permissions: ugo+rw Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2766da63-6cd3-4da9-bdee-855d9b6973a5 tempest-SnapshotDependencyTests-1810568490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:08 devstack sudo[90830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.info Feb 27 12:37:08 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:08 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-63482a1f-606f-449c-a169-a415a8577f07 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c93b172e-5f21-41df-82c6-500b27540966" returned: 0 in 0.466s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-63482a1f-606f-449c-a169-a415a8577f07 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c93b172e-5f21-41df-82c6-500b27540966 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:08 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c93b172e-5f21-41df-82c6-500b27540966 Feb 27 12:37:08 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:08 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-2766da63-6cd3-4da9-bdee-855d9b6973a5 tempest-SnapshotDependencyTests-1810568490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.info" returned: 0 in 0.384s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-2766da63-6cd3-4da9-bdee-855d9b6973a5 tempest-SnapshotDependencyTests-1810568490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.773s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.790s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1804664856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca6c17f-74a8-4a06-bd59-97f9d1e1012e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82718824221d4344b57d7a60a171bf6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:06Z,use_quota=True,user_id='207500f72ac747979e07efe5c4ad4dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Creating volume 7ca6c17f-74a8-4a06-bd59-97f9d1e1012e {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:37:08 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7ca6c17f-74a8-4a06-bd59-97f9d1e1012e 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:08 devstack sudo[90838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7ca6c17f-74a8-4a06-bd59-97f9d1e1012e 1073741824 Feb 27 12:37:08 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:08 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-2766da63-6cd3-4da9-bdee-855d9b6973a5 tempest-SnapshotDependencyTests-1810568490 None] Create snapshot completed successfully Feb 27 12:37:08 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-63482a1f-606f-449c-a169-a415a8577f07 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c93b172e-5f21-41df-82c6-500b27540966" returned: 0 in 0.397s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-63482a1f-606f-449c-a169-a415a8577f07 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-quobyte-c93b172e-5f21-41df-82c6-500b27540966" released by "delete_volume" :: held 0.881s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-63482a1f-606f-449c-a169-a415a8577f07 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Created reservations ['32e05738-b224-43f4-af04-618b297e47af', 'e07ba698-38bd-4b96-a989-37c28e4fcbc0', '37e4e08a-e9eb-4c64-86d3-b7cfe6e7b001', 'cb077978-07f3-49d2-9ab7-ce7b9d1d5a94'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-63482a1f-606f-449c-a169-a415a8577f07 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-63482a1f-606f-449c-a169-a415a8577f07 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-63482a1f-606f-449c-a169-a415a8577f07 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-63482a1f-606f-449c-a169-a415a8577f07 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-63482a1f-606f-449c-a169-a415a8577f07 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-63482a1f-606f-449c-a169-a415a8577f07 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:08 devstack sudo[90841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:37:08 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f00cc655-c7b1-4c15-af2b-edbc40abbdd7 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "cinder-fb2733f4-f9bf-43cf-903a-4923b40ac319-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f00cc655-c7b1-4c15-af2b-edbc40abbdd7 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-fb2733f4-f9bf-43cf-903a-4923b40ac319-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f00cc655-c7b1-4c15-af2b-edbc40abbdd7 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "cinder-quobyte-fb2733f4-f9bf-43cf-903a-4923b40ac319" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f00cc655-c7b1-4c15-af2b-edbc40abbdd7 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-quobyte-fb2733f4-f9bf-43cf-903a-4923b40ac319" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfbea98-66a4-4699-921e-f9d50a4491e4]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:08 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f00cc655-c7b1-4c15-af2b-edbc40abbdd7 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fb2733f4-f9bf-43cf-903a-4923b40ac319 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:08 devstack sudo[90845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fb2733f4-f9bf-43cf-903a-4923b40ac319 Feb 27 12:37:08 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:09 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7ca6c17f-74a8-4a06-bd59-97f9d1e1012e 1073741824" returned: 0 in 0.539s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7ca6c17f-74a8-4a06-bd59-97f9d1e1012e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:09 devstack sudo[90848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7ca6c17f-74a8-4a06-bd59-97f9d1e1012e Feb 27 12:37:09 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Flow 'volume_create_manager' (4dd658b6-13a2-445b-90f4-0311bc933d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5105e4d4-c74c-4883-9325-a8a5118df928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5105e4d4-c74c-4883-9325-a8a5118df928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eb4e801-d8e3-4cda-8647-e21e1786c36a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='753a25cc6bb14a91a623392f881af00b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d9f3b0f2-9e71-455c-908f-1c7e2149a0de,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:09Z,use_quota=True,user_id='bacda750039d46e49bcfd937d1055b4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57789d2c-8586-4aa2-8bd6-4c67be0c45f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57789d2c-8586-4aa2-8bd6-4c67be0c45f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7398d731-2111-4d4a-ac48-24289d29d4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7398d731-2111-4d4a-ac48-24289d29d4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5eb4e801-d8e3-4cda-8647-e21e1786c36a', 'volume_name': 'volume-5eb4e801-d8e3-4cda-8647-e21e1786c36a', 'volume_size': 1, 'snapshot_id': 'd9f3b0f2-9e71-455c-908f-1c7e2149a0de'}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52dcf284-cb39-485e-977d-083f31655e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:09 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52dcf284-cb39-485e-977d-083f31655e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc3af5c-33c2-475d-b962-aab47395e623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:09 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Volume 5eb4e801-d8e3-4cda-8647-e21e1786c36a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5eb4e801-d8e3-4cda-8647-e21e1786c36a', 'volume_size': 1, 'snapshot_id': 'd9f3b0f2-9e71-455c-908f-1c7e2149a0de'} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-63482a1f-606f-449c-a169-a415a8577f07 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.528s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-63482a1f-606f-449c-a169-a415a8577f07 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:09 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-63482a1f-606f-449c-a169-a415a8577f07 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Deleted volume successfully. Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-63482a1f-606f-449c-a169-a415a8577f07 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-c93b172e-5f21-41df-82c6-500b27540966-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:09 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f00cc655-c7b1-4c15-af2b-edbc40abbdd7 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fb2733f4-f9bf-43cf-903a-4923b40ac319" returned: 0 in 0.501s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f00cc655-c7b1-4c15-af2b-edbc40abbdd7 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fb2733f4-f9bf-43cf-903a-4923b40ac319 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:09 devstack sudo[90854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fb2733f4-f9bf-43cf-903a-4923b40ac319 Feb 27 12:37:09 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:09 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7ca6c17f-74a8-4a06-bd59-97f9d1e1012e" returned: 0 in 0.444s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.641s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-842048300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3224c6-062d-42b6-ad4a-786091a12b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82718824221d4344b57d7a60a171bf6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:06Z,use_quota=True,user_id='207500f72ac747979e07efe5c4ad4dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Creating volume ba3224c6-062d-42b6-ad4a-786091a12b0c {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:37:09 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-ba3224c6-062d-42b6-ad4a-786091a12b0c 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f51460-60df-4f87-b32e-d3d21870440f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ca6c17f-74a8-4a06-bd59-97f9d1e1012e', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99db0946-4809-4615-8997-9db6fe259764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:09 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Volume volume-7ca6c17f-74a8-4a06-bd59-97f9d1e1012e (7ca6c17f-74a8-4a06-bd59-97f9d1e1012e): created successfully Feb 27 12:37:09 devstack sudo[90857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-ba3224c6-062d-42b6-ad4a-786091a12b0c 1073741824 Feb 27 12:37:09 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99db0946-4809-4615-8997-9db6fe259764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Flow 'volume_create_manager' (df8ef9bf-a6d5-4efc-ab48-2f68ab15a573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:09 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-78febb66-c94e-494e-ba1b-b431e500216b tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Created volume successfully. Feb 27 12:37:09 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f00cc655-c7b1-4c15-af2b-edbc40abbdd7 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-fb2733f4-f9bf-43cf-903a-4923b40ac319" returned: 0 in 0.465s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f00cc655-c7b1-4c15-af2b-edbc40abbdd7 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-quobyte-fb2733f4-f9bf-43cf-903a-4923b40ac319" released by "delete_volume" :: held 0.988s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-f00cc655-c7b1-4c15-af2b-edbc40abbdd7 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Created reservations ['84c96fe5-b9f0-45c3-bd94-0b8da22cf6e8', 'b1882c86-d822-4de7-810b-5c1bb50322e7', 'd0475e43-6f3a-45ad-bcc6-683940efcfc4', '9d7bbbdf-ae58-437b-9eb2-bc5b36371780'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f00cc655-c7b1-4c15-af2b-edbc40abbdd7 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f00cc655-c7b1-4c15-af2b-edbc40abbdd7 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f00cc655-c7b1-4c15-af2b-edbc40abbdd7 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-f00cc655-c7b1-4c15-af2b-edbc40abbdd7 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-f00cc655-c7b1-4c15-af2b-edbc40abbdd7 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f00cc655-c7b1-4c15-af2b-edbc40abbdd7 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:09 devstack sudo[90863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:37:09 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:09 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:09 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-ba3224c6-062d-42b6-ad4a-786091a12b0c 1073741824" returned: 0 in 0.472s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-ba3224c6-062d-42b6-ad4a-786091a12b0c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:10 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-ba3224c6-062d-42b6-ad4a-786091a12b0c Feb 27 12:37:10 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:10 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f00cc655-c7b1-4c15-af2b-edbc40abbdd7 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.400s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-f00cc655-c7b1-4c15-af2b-edbc40abbdd7 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:10 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-f00cc655-c7b1-4c15-af2b-edbc40abbdd7 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Deleted volume successfully. Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f00cc655-c7b1-4c15-af2b-edbc40abbdd7 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-fb2733f4-f9bf-43cf-903a-4923b40ac319-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:10 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-ba3224c6-062d-42b6-ad4a-786091a12b0c" returned: 0 in 0.394s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.321s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1231830945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54493047-15fa-4c44-9090-bf78df01d7f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82718824221d4344b57d7a60a171bf6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:06Z,use_quota=True,user_id='207500f72ac747979e07efe5c4ad4dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Creating volume 54493047-15fa-4c44-9090-bf78df01d7f4 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:37:10 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-54493047-15fa-4c44-9090-bf78df01d7f4 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f865b4-bc0e-4caf-bdcb-8331234bdbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba3224c6-062d-42b6-ad4a-786091a12b0c', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:10 devstack sudo[90869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-54493047-15fa-4c44-9090-bf78df01d7f4 1073741824 Feb 27 12:37:10 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ad2b98-bf1f-4bdd-9d60-57b976303830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:10 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Volume volume-ba3224c6-062d-42b6-ad4a-786091a12b0c (ba3224c6-062d-42b6-ad4a-786091a12b0c): created successfully Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ad2b98-bf1f-4bdd-9d60-57b976303830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Flow 'volume_create_manager' (97f7544d-5bee-434a-bbb2-e35c7b715624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:10 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-bcce6f48-18ff-48aa-bd99-883abf5d88a6 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Created volume successfully. Feb 27 12:37:10 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-54493047-15fa-4c44-9090-bf78df01d7f4 1073741824" returned: 0 in 0.449s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-54493047-15fa-4c44-9090-bf78df01d7f4 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:10 devstack sudo[90874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-54493047-15fa-4c44-9090-bf78df01d7f4 Feb 27 12:37:10 devstack sudo[90874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f85debb6-2d23-4486-b8e1-0f1a287b6a25 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "cinder-671efea7-015d-4b15-a2e6-e0524a7cda8f-delete_snapshot" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f85debb6-2d23-4486-b8e1-0f1a287b6a25 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-671efea7-015d-4b15-a2e6-e0524a7cda8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f85debb6-2d23-4486-b8e1-0f1a287b6a25 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "cinder-quobyte-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f85debb6-2d23-4486-b8e1-0f1a287b6a25 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-quobyte-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f85debb6-2d23-4486-b8e1-0f1a287b6a25 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "cinder-quobyte-671efea7-015d-4b15-a2e6-e0524a7cda8f" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f85debb6-2d23-4486-b8e1-0f1a287b6a25 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-quobyte-671efea7-015d-4b15-a2e6-e0524a7cda8f" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-f85debb6-2d23-4486-b8e1-0f1a287b6a25 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Deleting offline snapshot 671efea7-015d-4b15-a2e6-e0524a7cda8f of volume c6ae2caf-91b6-4d9d-ae44-70ce8925bdae {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-f85debb6-2d23-4486-b8e1-0f1a287b6a25 tempest-CreateVolumesFromSnapshotTest-1457396782 None] snapshot_file for this snap is: volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae.671efea7-015d-4b15-a2e6-e0524a7cda8f {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b2628a-4136-41e2-aac0-8da9940cbdbc]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:10 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f85debb6-2d23-4486-b8e1-0f1a287b6a25 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae.671efea7-015d-4b15-a2e6-e0524a7cda8f {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:11 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae.671efea7-015d-4b15-a2e6-e0524a7cda8f Feb 27 12:37:11 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:11 devstack sudo[90874]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-54493047-15fa-4c44-9090-bf78df01d7f4" returned: 0 in 0.426s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:11 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:37:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.975s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:11 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-106460271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f14fb3-6245-44da-96ed-2bfe19bc68ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82718824221d4344b57d7a60a171bf6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:06Z,use_quota=True,user_id='207500f72ac747979e07efe5c4ad4dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:37:11 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Creating volume 48f14fb3-6245-44da-96ed-2bfe19bc68ec {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:37:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:11 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:11 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:11 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:37:11 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:37:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-48f14fb3-6245-44da-96ed-2bfe19bc68ec 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:11 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7034bdc-4a90-4252-a606-4d7a741db4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54493047-15fa-4c44-9090-bf78df01d7f4', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:11 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3312776-6f7b-4b38-ae09-83457136679b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:11 devstack sudo[90880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-48f14fb3-6245-44da-96ed-2bfe19bc68ec 1073741824 Feb 27 12:37:11 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:11 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Volume volume-54493047-15fa-4c44-9090-bf78df01d7f4 (54493047-15fa-4c44-9090-bf78df01d7f4): created successfully Feb 27 12:37:11 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3312776-6f7b-4b38-ae09-83457136679b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:11 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Flow 'volume_create_manager' (8aa9eb9d-eb6d-4dfc-b3de-4c173193185a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:11 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-81b13373-1b76-41b1-8b62-bcd115ec3eac tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Created volume successfully. Feb 27 12:37:11 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f85debb6-2d23-4486-b8e1-0f1a287b6a25 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae.671efea7-015d-4b15-a2e6-e0524a7cda8f" returned: 0 in 0.459s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:11 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-f85debb6-2d23-4486-b8e1-0f1a287b6a25 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:37:11 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c63629-7d6f-4b06-90b5-a245ed37390d]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f85debb6-2d23-4486-b8e1-0f1a287b6a25 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:11 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae Feb 27 12:37:11 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:11 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-48f14fb3-6245-44da-96ed-2bfe19bc68ec 1073741824" returned: 0 in 0.462s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-48f14fb3-6245-44da-96ed-2bfe19bc68ec {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:11 devstack sudo[90890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-48f14fb3-6245-44da-96ed-2bfe19bc68ec Feb 27 12:37:11 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:11 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f85debb6-2d23-4486-b8e1-0f1a287b6a25 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae" returned: 0 in 0.468s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:11 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f85debb6-2d23-4486-b8e1-0f1a287b6a25 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae.671efea7-015d-4b15-a2e6-e0524a7cda8f {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:11 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae.671efea7-015d-4b15-a2e6-e0524a7cda8f Feb 27 12:37:11 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:12 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-48f14fb3-6245-44da-96ed-2bfe19bc68ec" returned: 0 in 0.378s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:12 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:37:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.721s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:12 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-353318740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d945698-4554-4f09-9ea4-00d56555b787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82718824221d4344b57d7a60a171bf6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:06Z,use_quota=True,user_id='207500f72ac747979e07efe5c4ad4dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:37:12 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Creating volume 8d945698-4554-4f09-9ea4-00d56555b787 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:37:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:12 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:12 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:12 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:37:12 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:37:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8d945698-4554-4f09-9ea4-00d56555b787 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c70e970-eeca-4def-81e8-d8435ee65ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48f14fb3-6245-44da-96ed-2bfe19bc68ec', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f0d4d5-00ca-486b-aa8d-d75bcee94441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:12 devstack sudo[90898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8d945698-4554-4f09-9ea4-00d56555b787 1073741824 Feb 27 12:37:12 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:12 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Volume volume-48f14fb3-6245-44da-96ed-2bfe19bc68ec (48f14fb3-6245-44da-96ed-2bfe19bc68ec): created successfully Feb 27 12:37:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f0d4d5-00ca-486b-aa8d-d75bcee94441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:12 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Flow 'volume_create_manager' (0bf04b56-1206-4a45-b3cb-4a181fd07be5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:12 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-dc995659-eb0c-497b-98b0-fd7e9d54d7d3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Created volume successfully. Feb 27 12:37:12 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f85debb6-2d23-4486-b8e1-0f1a287b6a25 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae.671efea7-015d-4b15-a2e6-e0524a7cda8f" returned: 0 in 0.429s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f85debb6-2d23-4486-b8e1-0f1a287b6a25 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae.671efea7-015d-4b15-a2e6-e0524a7cda8f {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:12 devstack sudo[90903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae.671efea7-015d-4b15-a2e6-e0524a7cda8f Feb 27 12:37:12 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:12 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8d945698-4554-4f09-9ea4-00d56555b787 1073741824" returned: 0 in 0.483s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8d945698-4554-4f09-9ea4-00d56555b787 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:12 devstack sudo[90909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8d945698-4554-4f09-9ea4-00d56555b787 Feb 27 12:37:12 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:12 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:12 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-f85debb6-2d23-4486-b8e1-0f1a287b6a25 tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae.671efea7-015d-4b15-a2e6-e0524a7cda8f" returned: 0 in 0.395s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:12 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f85debb6-2d23-4486-b8e1-0f1a287b6a25 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-quobyte-671efea7-015d-4b15-a2e6-e0524a7cda8f" released by "_delete_snapshot" :: held 1.799s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:12 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f85debb6-2d23-4486-b8e1-0f1a287b6a25 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-quobyte-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae" released by "delete_snapshot" :: held 1.811s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:12 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-f85debb6-2d23-4486-b8e1-0f1a287b6a25 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Created reservations ['e2bea4ce-a572-44bc-8acf-de919172baed', '5180b808-070f-4b4d-99de-2f6893883414', 'b268d746-87f4-4eec-bf23-ce0d1924b21e', '664c8516-8a8e-4356-8c98-b838c5001ff8'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:12 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-f85debb6-2d23-4486-b8e1-0f1a287b6a25 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Delete snapshot completed successfully. Feb 27 12:37:12 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-f85debb6-2d23-4486-b8e1-0f1a287b6a25 tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-671efea7-015d-4b15-a2e6-e0524a7cda8f-delete_snapshot" released by "delete_snapshot" :: held 1.889s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:13 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc6c7b42-bdc0-468d-8780-9052ac033f3d tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "cinder-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:13 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc6c7b42-bdc0-468d-8780-9052ac033f3d tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:13 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc6c7b42-bdc0-468d-8780-9052ac033f3d tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "cinder-quobyte-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:13 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc6c7b42-bdc0-468d-8780-9052ac033f3d tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-quobyte-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae" acquired by "delete_volume" :: waited 0.006s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:13 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef767d3-6803-4952-a832-cdb954b0477a]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc6c7b42-bdc0-468d-8780-9052ac033f3d tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:13 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8d945698-4554-4f09-9ea4-00d56555b787" returned: 0 in 0.451s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:13 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:37:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.179s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:13 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Cloning volume 5208ddcf-6e19-4768-8228-22eb39cba324 to volume e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4 Feb 27 12:37:13 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae Feb 27 12:37:13 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (805860ca-89e2-4396-a922-32547647db23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d945698-4554-4f09-9ea4-00d56555b787', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (855d8e0b-1c70-4497-a980-8bd459333596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:13 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Volume volume-8d945698-4554-4f09-9ea4-00d56555b787 (8d945698-4554-4f09-9ea4-00d56555b787): created successfully Feb 27 12:37:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (855d8e0b-1c70-4497-a980-8bd459333596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:13 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Flow 'volume_create_manager' (8f481c66-7f84-43f7-82e3-ba11ac4dae25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:13 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Creating offline snapshot 8b930a5f-3cf3-4fa0-a0c7-e687f41349f3 of volume 5208ddcf-6e19-4768-8228-22eb39cba324 {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:37:13 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19ff385-a4f7-448c-89af-27a95c8feed7]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:13 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-0443e85d-3e45-4f19-a580-6f815027cc4e tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Created volume successfully. Feb 27 12:37:13 devstack sudo[90914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324 Feb 27 12:37:13 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:13 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc6c7b42-bdc0-468d-8780-9052ac033f3d tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae" returned: 0 in 0.451s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc6c7b42-bdc0-468d-8780-9052ac033f3d tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:13 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae Feb 27 12:37:13 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:13 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324" returned: 0 in 0.442s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.8b930a5f-3cf3-4fa0-a0c7-e687f41349f3 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:13 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.8b930a5f-3cf3-4fa0-a0c7-e687f41349f3 1G Feb 27 12:37:13 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:13 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:13 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc6c7b42-bdc0-468d-8780-9052ac033f3d tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae" returned: 0 in 0.397s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:13 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc6c7b42-bdc0-468d-8780-9052ac033f3d tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-quobyte-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae" released by "delete_volume" :: held 0.889s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:14 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-0c7ff45a-3620-4d8e-a35a-48c3f72f41c2 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "cinder-8d945698-4554-4f09-9ea4-00d56555b787-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:14 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-bc6c7b42-bdc0-468d-8780-9052ac033f3d tempest-CreateVolumesFromSnapshotTest-1457396782 None] Created reservations ['567f7981-b4aa-4cb9-b0c3-e1a5b1047510', 'fb8665fa-5781-46fc-87a2-2bbcac9a5130', '623377e5-fa33-4913-adab-bf5224ce7964', '1c015905-2ecb-4705-b134-d29f5b4a67d4'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:14 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-0c7ff45a-3620-4d8e-a35a-48c3f72f41c2 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "cinder-8d945698-4554-4f09-9ea4-00d56555b787-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:14 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-0c7ff45a-3620-4d8e-a35a-48c3f72f41c2 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "cinder-quobyte-8d945698-4554-4f09-9ea4-00d56555b787" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:14 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-0c7ff45a-3620-4d8e-a35a-48c3f72f41c2 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "cinder-quobyte-8d945698-4554-4f09-9ea4-00d56555b787" acquired by "delete_volume" :: waited 0.013s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:14 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a66967b-dc2f-4ee4-96ac-5194f1dd2241]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0c7ff45a-3620-4d8e-a35a-48c3f72f41c2 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8d945698-4554-4f09-9ea4-00d56555b787 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bc6c7b42-bdc0-468d-8780-9052ac033f3d tempest-CreateVolumesFromSnapshotTest-1457396782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bc6c7b42-bdc0-468d-8780-9052ac033f3d tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:14 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bc6c7b42-bdc0-468d-8780-9052ac033f3d tempest-CreateVolumesFromSnapshotTest-1457396782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:14 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bc6c7b42-bdc0-468d-8780-9052ac033f3d tempest-CreateVolumesFromSnapshotTest-1457396782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bc6c7b42-bdc0-468d-8780-9052ac033f3d tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc6c7b42-bdc0-468d-8780-9052ac033f3d tempest-CreateVolumesFromSnapshotTest-1457396782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:14 devstack sudo[90931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:37:14 devstack sudo[90931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:14 devstack sudo[90930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8d945698-4554-4f09-9ea4-00d56555b787 Feb 27 12:37:14 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:14 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.8b930a5f-3cf3-4fa0-a0c7-e687f41349f3 1G" returned: 0 in 0.569s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5208ddcf-6e19-4768-8228-22eb39cba324 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.8b930a5f-3cf3-4fa0-a0c7-e687f41349f3 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:14 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5208ddcf-6e19-4768-8228-22eb39cba324 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.8b930a5f-3cf3-4fa0-a0c7-e687f41349f3 Feb 27 12:37:14 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:14 devstack sudo[90931]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc6c7b42-bdc0-468d-8780-9052ac033f3d tempest-CreateVolumesFromSnapshotTest-1457396782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.460s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:14 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-bc6c7b42-bdc0-468d-8780-9052ac033f3d tempest-CreateVolumesFromSnapshotTest-1457396782 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:14 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-bc6c7b42-bdc0-468d-8780-9052ac033f3d tempest-CreateVolumesFromSnapshotTest-1457396782 None] Deleted volume successfully. Feb 27 12:37:14 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc6c7b42-bdc0-468d-8780-9052ac033f3d tempest-CreateVolumesFromSnapshotTest-1457396782 None] Lock "cinder-c6ae2caf-91b6-4d9d-ae44-70ce8925bdae-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:14 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0c7ff45a-3620-4d8e-a35a-48c3f72f41c2 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8d945698-4554-4f09-9ea4-00d56555b787" returned: 0 in 0.621s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:14 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0c7ff45a-3620-4d8e-a35a-48c3f72f41c2 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8d945698-4554-4f09-9ea4-00d56555b787 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5208ddcf-6e19-4768-8228-22eb39cba324 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.8b930a5f-3cf3-4fa0-a0c7-e687f41349f3" returned: 0 in 0.458s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:14 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.8b930a5f-3cf3-4fa0-a0c7-e687f41349f3 is being set with open permissions: ugo+rw Feb 27 12:37:14 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.8b930a5f-3cf3-4fa0-a0c7-e687f41349f3 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:14 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8d945698-4554-4f09-9ea4-00d56555b787 Feb 27 12:37:14 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:14 devstack sudo[90944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.8b930a5f-3cf3-4fa0-a0c7-e687f41349f3 Feb 27 12:37:14 devstack sudo[90944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:15 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0c7ff45a-3620-4d8e-a35a-48c3f72f41c2 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-8d945698-4554-4f09-9ea4-00d56555b787" returned: 0 in 0.472s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-0c7ff45a-3620-4d8e-a35a-48c3f72f41c2 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "cinder-quobyte-8d945698-4554-4f09-9ea4-00d56555b787" released by "delete_volume" :: held 1.113s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:15 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-0c7ff45a-3620-4d8e-a35a-48c3f72f41c2 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Created reservations ['5ff1a4d3-2c50-462f-b34a-0eb1904747dc', '83617951-c3c1-40fd-a779-c518b1cf8dc7', 'ad4fbc5f-576c-497d-bd55-beda9602bfa0', '648cca52-aa17-4a6c-bba7-04c05a314554'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:15 devstack sudo[90944]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.8b930a5f-3cf3-4fa0-a0c7-e687f41349f3" returned: 0 in 0.506s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:15 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.info Feb 27 12:37:15 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0c7ff45a-3620-4d8e-a35a-48c3f72f41c2 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0c7ff45a-3620-4d8e-a35a-48c3f72f41c2 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0c7ff45a-3620-4d8e-a35a-48c3f72f41c2 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:15 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-0c7ff45a-3620-4d8e-a35a-48c3f72f41c2 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0c7ff45a-3620-4d8e-a35a-48c3f72f41c2 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0c7ff45a-3620-4d8e-a35a-48c3f72f41c2 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:15 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:37:15 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:15 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.info" returned: 0 in 0.401s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:15 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.info is being set with open permissions: ugo+rw Feb 27 12:37:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:15 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.info Feb 27 12:37:15 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:15 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:15 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0c7ff45a-3620-4d8e-a35a-48c3f72f41c2 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.397s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:15 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-0c7ff45a-3620-4d8e-a35a-48c3f72f41c2 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:15 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-0c7ff45a-3620-4d8e-a35a-48c3f72f41c2 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Deleted volume successfully. Feb 27 12:37:15 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-0c7ff45a-3620-4d8e-a35a-48c3f72f41c2 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "cinder-8d945698-4554-4f09-9ea4-00d56555b787-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:16 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.info" returned: 0 in 0.386s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:16 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Acquiring lock "cinder-quobyte-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4" by "_copy_volume_from_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:16 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Lock "cinder-quobyte-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] snapshot: 8b930a5f-3cf3-4fa0-a0c7-e687f41349f3, volume: e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4, {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 12:37:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:16 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77801b9-6b70-427b-84b6-4b12cfac33f9]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.8b930a5f-3cf3-4fa0-a0c7-e687f41349f3 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:16 devstack sudo[90958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.8b930a5f-3cf3-4fa0-a0c7-e687f41349f3 Feb 27 12:37:16 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:16 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d13e051c-652e-4a4c-8aaa-eaa4975316b0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "cinder-48f14fb3-6245-44da-96ed-2bfe19bc68ec-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:16 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d13e051c-652e-4a4c-8aaa-eaa4975316b0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "cinder-48f14fb3-6245-44da-96ed-2bfe19bc68ec-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:16 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d13e051c-652e-4a4c-8aaa-eaa4975316b0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "cinder-quobyte-48f14fb3-6245-44da-96ed-2bfe19bc68ec" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:16 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d13e051c-652e-4a4c-8aaa-eaa4975316b0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "cinder-quobyte-48f14fb3-6245-44da-96ed-2bfe19bc68ec" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:16 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[422d1fb2-afc4-4fff-bb97-bb97e4fcbb3e]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d13e051c-652e-4a4c-8aaa-eaa4975316b0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-48f14fb3-6245-44da-96ed-2bfe19bc68ec {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:16 devstack sudo[90960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-48f14fb3-6245-44da-96ed-2bfe19bc68ec Feb 27 12:37:16 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:16 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.8b930a5f-3cf3-4fa0-a0c7-e687f41349f3" returned: 0 in 0.496s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5208ddcf-6e19-4768-8228-22eb39cba324(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:37:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324 {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 12:37:16 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Creating direct copy from snapshot {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 12:37:16 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefa12a8-fa0a-4266-ba0b-ebf5460dfa36]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:16 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324 Feb 27 12:37:16 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:16 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d13e051c-652e-4a4c-8aaa-eaa4975316b0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-48f14fb3-6245-44da-96ed-2bfe19bc68ec" returned: 0 in 0.481s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:16 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d13e051c-652e-4a4c-8aaa-eaa4975316b0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-48f14fb3-6245-44da-96ed-2bfe19bc68ec {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:16 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-48f14fb3-6245-44da-96ed-2bfe19bc68ec Feb 27 12:37:16 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:17 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324" returned: 0 in 0.545s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:17 devstack cinder-volume[83077]: DEBUG cinder.utils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Path /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4 not found in is_blk_device check {{(pid=83077) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 12:37:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:17 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d13e051c-652e-4a4c-8aaa-eaa4975316b0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-48f14fb3-6245-44da-96ed-2bfe19bc68ec" returned: 0 in 0.383s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:17 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4 Feb 27 12:37:17 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d13e051c-652e-4a4c-8aaa-eaa4975316b0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "cinder-quobyte-48f14fb3-6245-44da-96ed-2bfe19bc68ec" released by "delete_volume" :: held 0.897s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:17 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-d13e051c-652e-4a4c-8aaa-eaa4975316b0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Created reservations ['2524c0e9-0f23-450c-b390-bfa62f8ae274', '8c14e6e3-0b28-41af-ad76-e6d583e9e18e', 'b4611c62-725f-48fe-bf4e-249f4417d41a', 'e020fe24-8533-4be4-8f99-1359c5b5da27'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d13e051c-652e-4a4c-8aaa-eaa4975316b0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d13e051c-652e-4a4c-8aaa-eaa4975316b0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:17 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d13e051c-652e-4a4c-8aaa-eaa4975316b0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:17 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d13e051c-652e-4a4c-8aaa-eaa4975316b0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d13e051c-652e-4a4c-8aaa-eaa4975316b0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d13e051c-652e-4a4c-8aaa-eaa4975316b0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:17 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:37:17 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-fb1ab2c5-6107-433a-a232-430606a092e0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "cinder-54493047-15fa-4c44-9090-bf78df01d7f4-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-fb1ab2c5-6107-433a-a232-430606a092e0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "cinder-54493047-15fa-4c44-9090-bf78df01d7f4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-fb1ab2c5-6107-433a-a232-430606a092e0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "cinder-quobyte-54493047-15fa-4c44-9090-bf78df01d7f4" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-fb1ab2c5-6107-433a-a232-430606a092e0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "cinder-quobyte-54493047-15fa-4c44-9090-bf78df01d7f4" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:17 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f25768-3ec8-49f7-9780-e86f14a7166f]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-fb1ab2c5-6107-433a-a232-430606a092e0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-54493047-15fa-4c44-9090-bf78df01d7f4 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:17 devstack sudo[90980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-54493047-15fa-4c44-9090-bf78df01d7f4 Feb 27 12:37:17 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:17 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:17 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d13e051c-652e-4a4c-8aaa-eaa4975316b0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.588s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:17 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-d13e051c-652e-4a4c-8aaa-eaa4975316b0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:17 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-d13e051c-652e-4a4c-8aaa-eaa4975316b0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Deleted volume successfully. Feb 27 12:37:17 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d13e051c-652e-4a4c-8aaa-eaa4975316b0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "cinder-48f14fb3-6245-44da-96ed-2bfe19bc68ec-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:18 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-fb1ab2c5-6107-433a-a232-430606a092e0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-54493047-15fa-4c44-9090-bf78df01d7f4" returned: 0 in 0.784s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:18 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-fb1ab2c5-6107-433a-a232-430606a092e0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-54493047-15fa-4c44-9090-bf78df01d7f4 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:18 devstack sudo[90996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-54493047-15fa-4c44-9090-bf78df01d7f4 Feb 27 12:37:18 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:19 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:19 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-fb1ab2c5-6107-433a-a232-430606a092e0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-54493047-15fa-4c44-9090-bf78df01d7f4" returned: 0 in 0.950s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4" returned: 0 in 2.054s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:19 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-fb1ab2c5-6107-433a-a232-430606a092e0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "cinder-quobyte-54493047-15fa-4c44-9090-bf78df01d7f4" released by "delete_volume" :: held 1.765s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:19 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0e3ee4-32de-481a-a231-0aaee9fbcb43]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:19 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-fb1ab2c5-6107-433a-a232-430606a092e0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Created reservations ['8e2736cd-fcfb-456e-bc03-768c1f44eb3d', 'da29761e-5fe6-4fac-a859-b75793293680', '913ad375-fe62-4f23-a0bd-7fab5f35c42c', '6bbc42e0-c065-4449-a30a-1c9eabba0d52'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:19 devstack sudo[90999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324 Feb 27 12:37:19 devstack sudo[90999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-fb1ab2c5-6107-433a-a232-430606a092e0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-fb1ab2c5-6107-433a-a232-430606a092e0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-fb1ab2c5-6107-433a-a232-430606a092e0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:19 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-fb1ab2c5-6107-433a-a232-430606a092e0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-fb1ab2c5-6107-433a-a232-430606a092e0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-fb1ab2c5-6107-433a-a232-430606a092e0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:19 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:37:19 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:19 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-23cb69b4-282e-45ee-a16e-52824aa3a0b3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "cinder-ba3224c6-062d-42b6-ad4a-786091a12b0c-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:19 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-23cb69b4-282e-45ee-a16e-52824aa3a0b3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "cinder-ba3224c6-062d-42b6-ad4a-786091a12b0c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:19 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-23cb69b4-282e-45ee-a16e-52824aa3a0b3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "cinder-quobyte-ba3224c6-062d-42b6-ad4a-786091a12b0c" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:19 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-23cb69b4-282e-45ee-a16e-52824aa3a0b3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "cinder-quobyte-ba3224c6-062d-42b6-ad4a-786091a12b0c" acquired by "delete_volume" :: waited 0.007s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:19 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1633bc-ba6d-4e8b-840a-5b74467eb831]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-23cb69b4-282e-45ee-a16e-52824aa3a0b3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-ba3224c6-062d-42b6-ad4a-786091a12b0c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:19 devstack sudo[91006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-ba3224c6-062d-42b6-ad4a-786091a12b0c Feb 27 12:37:19 devstack sudo[91006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:19 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-fb1ab2c5-6107-433a-a232-430606a092e0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.443s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:19 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-fb1ab2c5-6107-433a-a232-430606a092e0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:19 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-fb1ab2c5-6107-433a-a232-430606a092e0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Deleted volume successfully. Feb 27 12:37:19 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-fb1ab2c5-6107-433a-a232-430606a092e0 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "cinder-54493047-15fa-4c44-9090-bf78df01d7f4-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:19 devstack sudo[90999]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324" returned: 0 in 0.626s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:19 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Image conversion details: src /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324, size 1024.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4 {{(pid=83077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:37:19 devstack cinder-volume[83077]: INFO cinder.image.image_utils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Converted 1024.00 MB image at 498.36 MB/s Feb 27 12:37:19 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4 is being set with open permissions: ugo+rw Feb 27 12:37:19 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:19 devstack sudo[91009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4 Feb 27 12:37:19 devstack sudo[91009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:20 devstack sudo[91006]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-23cb69b4-282e-45ee-a16e-52824aa3a0b3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-ba3224c6-062d-42b6-ad4a-786091a12b0c" returned: 0 in 0.468s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-23cb69b4-282e-45ee-a16e-52824aa3a0b3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-ba3224c6-062d-42b6-ad4a-786091a12b0c {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:20 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-ba3224c6-062d-42b6-ad4a-786091a12b0c Feb 27 12:37:20 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:20 devstack sudo[91009]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4" returned: 0 in 0.404s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Lock "cinder-quobyte-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4" released by "_copy_volume_from_snapshot" :: held 4.173s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Acquiring lock "cinder-quobyte-8b930a5f-3cf3-4fa0-a0c7-e687f41349f3" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Lock "cinder-quobyte-8b930a5f-3cf3-4fa0-a0c7-e687f41349f3" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Deleting offline snapshot 8b930a5f-3cf3-4fa0-a0c7-e687f41349f3 of volume 5208ddcf-6e19-4768-8228-22eb39cba324 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] snapshot_file for this snap is: volume-5208ddcf-6e19-4768-8228-22eb39cba324.8b930a5f-3cf3-4fa0-a0c7-e687f41349f3 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec1aa34-39b1-42dd-aa43-f5dad4b22453]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.8b930a5f-3cf3-4fa0-a0c7-e687f41349f3 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:20 devstack sudo[91017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.8b930a5f-3cf3-4fa0-a0c7-e687f41349f3 Feb 27 12:37:20 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:20 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-23cb69b4-282e-45ee-a16e-52824aa3a0b3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-ba3224c6-062d-42b6-ad4a-786091a12b0c" returned: 0 in 0.386s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-23cb69b4-282e-45ee-a16e-52824aa3a0b3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "cinder-quobyte-ba3224c6-062d-42b6-ad4a-786091a12b0c" released by "delete_volume" :: held 0.883s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-23cb69b4-282e-45ee-a16e-52824aa3a0b3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Created reservations ['0d7f6517-8942-456a-b5e0-e17178808d34', 'c38ebb3a-9a55-48d4-ae19-127d11fe11d5', '4241bff4-fa6c-4697-b203-95cc837e62f6', '70f25838-8631-4efa-9d56-f1655ee20634'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-23cb69b4-282e-45ee-a16e-52824aa3a0b3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-23cb69b4-282e-45ee-a16e-52824aa3a0b3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-23cb69b4-282e-45ee-a16e-52824aa3a0b3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-23cb69b4-282e-45ee-a16e-52824aa3a0b3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-23cb69b4-282e-45ee-a16e-52824aa3a0b3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-23cb69b4-282e-45ee-a16e-52824aa3a0b3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:20 devstack sudo[91020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:37:20 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d543ec67-14c1-404b-86d2-c5adeea66c55 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "cinder-7ca6c17f-74a8-4a06-bd59-97f9d1e1012e-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d543ec67-14c1-404b-86d2-c5adeea66c55 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "cinder-7ca6c17f-74a8-4a06-bd59-97f9d1e1012e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d543ec67-14c1-404b-86d2-c5adeea66c55 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "cinder-quobyte-7ca6c17f-74a8-4a06-bd59-97f9d1e1012e" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d543ec67-14c1-404b-86d2-c5adeea66c55 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "cinder-quobyte-7ca6c17f-74a8-4a06-bd59-97f9d1e1012e" acquired by "delete_volume" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2233d5-0406-4d61-8709-b55a95c06dea]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d543ec67-14c1-404b-86d2-c5adeea66c55 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7ca6c17f-74a8-4a06-bd59-97f9d1e1012e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:20 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.8b930a5f-3cf3-4fa0-a0c7-e687f41349f3" returned: 0 in 0.573s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5208ddcf-6e19-4768-8228-22eb39cba324(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c614a18-a14c-4fe4-ba5b-c3f19f0f38f8]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:20 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:20 devstack sudo[91025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7ca6c17f-74a8-4a06-bd59-97f9d1e1012e Feb 27 12:37:20 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:20 devstack sudo[91026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324 Feb 27 12:37:20 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:21 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-23cb69b4-282e-45ee-a16e-52824aa3a0b3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.468s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:21 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-23cb69b4-282e-45ee-a16e-52824aa3a0b3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:21 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-23cb69b4-282e-45ee-a16e-52824aa3a0b3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Deleted volume successfully. Feb 27 12:37:21 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-23cb69b4-282e-45ee-a16e-52824aa3a0b3 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "cinder-ba3224c6-062d-42b6-ad4a-786091a12b0c-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:21 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324" returned: 0 in 0.455s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.8b930a5f-3cf3-4fa0-a0c7-e687f41349f3 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:21 devstack sudo[91037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.8b930a5f-3cf3-4fa0-a0c7-e687f41349f3 Feb 27 12:37:21 devstack sudo[91037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:21 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d543ec67-14c1-404b-86d2-c5adeea66c55 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7ca6c17f-74a8-4a06-bd59-97f9d1e1012e" returned: 0 in 0.509s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d543ec67-14c1-404b-86d2-c5adeea66c55 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7ca6c17f-74a8-4a06-bd59-97f9d1e1012e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:21 devstack sudo[91039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7ca6c17f-74a8-4a06-bd59-97f9d1e1012e Feb 27 12:37:21 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:21 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d543ec67-14c1-404b-86d2-c5adeea66c55 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-7ca6c17f-74a8-4a06-bd59-97f9d1e1012e" returned: 0 in 0.401s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:21 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d543ec67-14c1-404b-86d2-c5adeea66c55 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "cinder-quobyte-7ca6c17f-74a8-4a06-bd59-97f9d1e1012e" released by "delete_volume" :: held 0.939s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:21 devstack sudo[91037]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.8b930a5f-3cf3-4fa0-a0c7-e687f41349f3" returned: 0 in 0.460s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.8b930a5f-3cf3-4fa0-a0c7-e687f41349f3 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:21 devstack sudo[91045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.8b930a5f-3cf3-4fa0-a0c7-e687f41349f3 Feb 27 12:37:21 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:21 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-d543ec67-14c1-404b-86d2-c5adeea66c55 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Created reservations ['b1f5d2fb-4bac-44a0-b56a-fe6831841b5f', 'd56185e7-f7f2-4015-a138-bcccc4a4578e', 'e2302259-e819-4926-85af-6fd8d1d9104a', 'a02952b4-c86b-4cf7-b2bf-cae27aad3808'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d543ec67-14c1-404b-86d2-c5adeea66c55 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d543ec67-14c1-404b-86d2-c5adeea66c55 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:21 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d543ec67-14c1-404b-86d2-c5adeea66c55 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:21 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d543ec67-14c1-404b-86d2-c5adeea66c55 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d543ec67-14c1-404b-86d2-c5adeea66c55 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d543ec67-14c1-404b-86d2-c5adeea66c55 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:21 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:37:21 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:21 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6084990f-259b-4ffc-ae11-1498370da69c tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "cinder-6efa597b-1327-4241-b7c8-c58576a3ae6d-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:21 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6084990f-259b-4ffc-ae11-1498370da69c tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "cinder-6efa597b-1327-4241-b7c8-c58576a3ae6d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:21 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6084990f-259b-4ffc-ae11-1498370da69c tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "cinder-quobyte-6efa597b-1327-4241-b7c8-c58576a3ae6d" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:21 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6084990f-259b-4ffc-ae11-1498370da69c tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "cinder-quobyte-6efa597b-1327-4241-b7c8-c58576a3ae6d" acquired by "delete_volume" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:21 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[229208f6-aef4-46e2-866b-19d5a19544d4]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:21 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6084990f-259b-4ffc-ae11-1498370da69c tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6efa597b-1327-4241-b7c8-c58576a3ae6d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:22 devstack sudo[91049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6efa597b-1327-4241-b7c8-c58576a3ae6d Feb 27 12:37:22 devstack sudo[91049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:22 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324.8b930a5f-3cf3-4fa0-a0c7-e687f41349f3" returned: 0 in 0.446s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Lock "cinder-quobyte-8b930a5f-3cf3-4fa0-a0c7-e687f41349f3" released by "_delete_snapshot" :: held 1.986s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.059s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 13.035s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Acquiring lock "cinder-quobyte-d9f3b0f2-9e71-455c-908f-1c7e2149a0de-5eb4e801-d8e3-4cda-8647-e21e1786c36a" by "_create_volume_from_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e5b1c4e-1277-4c37-bc0c-5515607fa182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4', 'volume_size': 1, 'source_volid': '5208ddcf-6e19-4768-8228-22eb39cba324', 'source_volstatus': 'available'}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (806885ba-c0e7-442e-99f4-a549962da5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Lock "cinder-quobyte-d9f3b0f2-9e71-455c-908f-1c7e2149a0de-5eb4e801-d8e3-4cda-8647-e21e1786c36a" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Creating volume 5eb4e801-d8e3-4cda-8647-e21e1786c36a from snapshot d9f3b0f2-9e71-455c-908f-1c7e2149a0de {{(pid=83077) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Acquiring lock "cinder-quobyte-5eb4e801-d8e3-4cda-8647-e21e1786c36a" by "_copy_volume_from_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:22 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Volume volume-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4 (e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4): created successfully Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (806885ba-c0e7-442e-99f4-a549962da5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Flow 'volume_create_manager' (e4381726-3360-48d3-be8c-2cae247f9e76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Lock "cinder-quobyte-5eb4e801-d8e3-4cda-8647-e21e1786c36a" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] snapshot: d9f3b0f2-9e71-455c-908f-1c7e2149a0de, volume: 5eb4e801-d8e3-4cda-8647-e21e1786c36a, {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[2888c918-623c-46e4-bb0b-ba7f2fb10706]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.d9f3b0f2-9e71-455c-908f-1c7e2149a0de {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:22 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-7827c247-84b1-4616-a9c4-51243923c788 tempest-VolumeDependencyTests-56553957 None] Created volume successfully. Feb 27 12:37:22 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d543ec67-14c1-404b-86d2-c5adeea66c55 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.513s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-d543ec67-14c1-404b-86d2-c5adeea66c55 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:22 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-d543ec67-14c1-404b-86d2-c5adeea66c55 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Deleted volume successfully. Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d543ec67-14c1-404b-86d2-c5adeea66c55 tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "cinder-7ca6c17f-74a8-4a06-bd59-97f9d1e1012e-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:22 devstack sudo[91053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.d9f3b0f2-9e71-455c-908f-1c7e2149a0de Feb 27 12:37:22 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:22 devstack sudo[91049]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6084990f-259b-4ffc-ae11-1498370da69c tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6efa597b-1327-4241-b7c8-c58576a3ae6d" returned: 0 in 0.535s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6084990f-259b-4ffc-ae11-1498370da69c tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6efa597b-1327-4241-b7c8-c58576a3ae6d {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:22 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6efa597b-1327-4241-b7c8-c58576a3ae6d Feb 27 12:37:22 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:22 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.d9f3b0f2-9e71-455c-908f-1c7e2149a0de" returned: 0 in 0.496s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d449917-5611-408e-b78a-2cb05176464b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Creating direct copy from snapshot {{(pid=83077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d555a1-95a5-44af-991c-4ea727c72ea6]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-63f94b29-5d67-4ba0-8454-1d3644d7a464 tempest-VolumeDependencyTests-56553957 None] Acquiring lock "cinder-5208ddcf-6e19-4768-8228-22eb39cba324-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-63f94b29-5d67-4ba0-8454-1d3644d7a464 tempest-VolumeDependencyTests-56553957 None] Lock "cinder-5208ddcf-6e19-4768-8228-22eb39cba324-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-63f94b29-5d67-4ba0-8454-1d3644d7a464 tempest-VolumeDependencyTests-56553957 None] Acquiring lock "cinder-quobyte-5208ddcf-6e19-4768-8228-22eb39cba324" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-63f94b29-5d67-4ba0-8454-1d3644d7a464 tempest-VolumeDependencyTests-56553957 None] Lock "cinder-quobyte-5208ddcf-6e19-4768-8228-22eb39cba324" acquired by "delete_volume" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9a861e-97ae-45b6-abaf-0be36f40967b]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:22 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-63f94b29-5d67-4ba0-8454-1d3644d7a464 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:22 devstack sudo[91063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b Feb 27 12:37:22 devstack sudo[91063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:22 devstack sudo[91065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324 Feb 27 12:37:22 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:23 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6084990f-259b-4ffc-ae11-1498370da69c tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-6efa597b-1327-4241-b7c8-c58576a3ae6d" returned: 0 in 0.534s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:23 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6084990f-259b-4ffc-ae11-1498370da69c tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "cinder-quobyte-6efa597b-1327-4241-b7c8-c58576a3ae6d" released by "delete_volume" :: held 1.090s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:23 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-6084990f-259b-4ffc-ae11-1498370da69c tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Created reservations ['887ec8d9-fda4-40aa-9e97-626a495e3780', '21a18f87-9da4-4644-a9ed-67ca45488734', '40f89fe4-0dfb-461f-99a7-192cb0c96896', '2a89c33f-19c3-4a12-b9cf-2b381fc2c059'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6084990f-259b-4ffc-ae11-1498370da69c tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6084990f-259b-4ffc-ae11-1498370da69c tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:23 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6084990f-259b-4ffc-ae11-1498370da69c tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:23 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-6084990f-259b-4ffc-ae11-1498370da69c tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-6084990f-259b-4ffc-ae11-1498370da69c tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6084990f-259b-4ffc-ae11-1498370da69c tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:23 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:37:23 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:23 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-63f94b29-5d67-4ba0-8454-1d3644d7a464 tempest-VolumeDependencyTests-56553957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324" returned: 0 in 0.511s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-63f94b29-5d67-4ba0-8454-1d3644d7a464 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:23 devstack sudo[91076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324 Feb 27 12:37:23 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:23 devstack sudo[91063]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b" returned: 0 in 0.622s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:23 devstack cinder-volume[83077]: DEBUG cinder.utils [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Path /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5eb4e801-d8e3-4cda-8647-e21e1786c36a not found in is_blk_device check {{(pid=83077) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 12:37:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5eb4e801-d8e3-4cda-8647-e21e1786c36a {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:23 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5eb4e801-d8e3-4cda-8647-e21e1786c36a Feb 27 12:37:23 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:23 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-6084990f-259b-4ffc-ae11-1498370da69c tempest-CreateVolumesFromSourceVolumeTest-986862969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.449s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:23 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-6084990f-259b-4ffc-ae11-1498370da69c tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:23 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-6084990f-259b-4ffc-ae11-1498370da69c tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Deleted volume successfully. Feb 27 12:37:23 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-6084990f-259b-4ffc-ae11-1498370da69c tempest-CreateVolumesFromSourceVolumeTest-986862969 None] Lock "cinder-6efa597b-1327-4241-b7c8-c58576a3ae6d-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:23 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-63f94b29-5d67-4ba0-8454-1d3644d7a464 tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5208ddcf-6e19-4768-8228-22eb39cba324" returned: 0 in 0.409s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:23 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-63f94b29-5d67-4ba0-8454-1d3644d7a464 tempest-VolumeDependencyTests-56553957 None] Lock "cinder-quobyte-5208ddcf-6e19-4768-8228-22eb39cba324" released by "delete_volume" :: held 0.949s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:23 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-63f94b29-5d67-4ba0-8454-1d3644d7a464 tempest-VolumeDependencyTests-56553957 None] Created reservations ['55ed4c43-e926-4d24-830d-ad658af3cb82', 'b5161489-c6fe-4927-9e9a-0033a546a444', '2dd7e2b0-9ff9-424e-9423-50a569e34a68', 'e995eb0c-418b-4226-8657-59df8500ae1a'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-63f94b29-5d67-4ba0-8454-1d3644d7a464 tempest-VolumeDependencyTests-56553957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-63f94b29-5d67-4ba0-8454-1d3644d7a464 tempest-VolumeDependencyTests-56553957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:23 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-63f94b29-5d67-4ba0-8454-1d3644d7a464 tempest-VolumeDependencyTests-56553957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:23 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-63f94b29-5d67-4ba0-8454-1d3644d7a464 tempest-VolumeDependencyTests-56553957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:23 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-63f94b29-5d67-4ba0-8454-1d3644d7a464 tempest-VolumeDependencyTests-56553957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-63f94b29-5d67-4ba0-8454-1d3644d7a464 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:24 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1d22e194-d3a0-4e03-9485-dbc4700b96c4 tempest-VolumeDependencyTests-56553957 None] Acquiring lock "cinder-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:24 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1d22e194-d3a0-4e03-9485-dbc4700b96c4 tempest-VolumeDependencyTests-56553957 None] Lock "cinder-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:24 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1d22e194-d3a0-4e03-9485-dbc4700b96c4 tempest-VolumeDependencyTests-56553957 None] Acquiring lock "cinder-quobyte-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:24 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1d22e194-d3a0-4e03-9485-dbc4700b96c4 tempest-VolumeDependencyTests-56553957 None] Lock "cinder-quobyte-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4" acquired by "delete_volume" :: waited 0.015s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:24 devstack sudo[91093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:37:24 devstack sudo[91093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:24 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad70f83-6bbf-4367-8b21-6cf7f48c199a]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:24 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1d22e194-d3a0-4e03-9485-dbc4700b96c4 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:24 devstack sudo[91095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4 Feb 27 12:37:24 devstack sudo[91095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:25 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5eb4e801-d8e3-4cda-8647-e21e1786c36a" returned: 0 in 2.232s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:25 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9963c5c9-fcb1-4b2f-9fdc-15be4aa1e666]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:25 devstack sudo[91100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b Feb 27 12:37:25 devstack sudo[91100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:25 devstack sudo[91093]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-63f94b29-5d67-4ba0-8454-1d3644d7a464 tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 1.822s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:25 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-63f94b29-5d67-4ba0-8454-1d3644d7a464 tempest-VolumeDependencyTests-56553957 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:25 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-63f94b29-5d67-4ba0-8454-1d3644d7a464 tempest-VolumeDependencyTests-56553957 None] Deleted volume successfully. Feb 27 12:37:25 devstack cinder-volume[83077]: DEBUG dbcounter [-] [83077] Writing DB stats cinder:SELECT=173,cinder:INSERT=71,cinder:UPDATE=230,cinder:DELETE=25 {{(pid=83077) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:37:25 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-63f94b29-5d67-4ba0-8454-1d3644d7a464 tempest-VolumeDependencyTests-56553957 None] Lock "cinder-5208ddcf-6e19-4768-8228-22eb39cba324-delete_volume" released by "delete_volume" :: held 2.991s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:25 devstack sudo[91095]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1d22e194-d3a0-4e03-9485-dbc4700b96c4 tempest-VolumeDependencyTests-56553957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4" returned: 0 in 1.627s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:25 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1d22e194-d3a0-4e03-9485-dbc4700b96c4 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:25 devstack sudo[91103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4 Feb 27 12:37:25 devstack sudo[91103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:26 devstack sudo[91103]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1d22e194-d3a0-4e03-9485-dbc4700b96c4 tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4" returned: 0 in 0.490s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:26 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1d22e194-d3a0-4e03-9485-dbc4700b96c4 tempest-VolumeDependencyTests-56553957 None] Lock "cinder-quobyte-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4" released by "delete_volume" :: held 2.163s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:26 devstack cinder-volume[83077]: DEBUG dbcounter [-] [83077] Writing DB stats cinder:SELECT=173,cinder:UPDATE=257,cinder:INSERT=43,cinder:DELETE=20 {{(pid=83077) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:37:26 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-1d22e194-d3a0-4e03-9485-dbc4700b96c4 tempest-VolumeDependencyTests-56553957 None] Created reservations ['b1d10796-18a4-41c7-a189-6ae73aaf5b24', '932fa67d-c721-4b2f-ae45-41b3f45947cb', 'dc7c7744-e7ef-430a-8741-645e39daf970', 'd585f757-04d7-4dbd-b692-38445d4e132b'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:26 devstack sudo[91100]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b" returned: 0 in 0.734s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:26 devstack cinder-volume[83077]: DEBUG cinder.image.image_utils [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Image conversion details: src /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b, size 1024.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5eb4e801-d8e3-4cda-8647-e21e1786c36a {{(pid=83077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:37:26 devstack cinder-volume[83077]: INFO cinder.image.image_utils [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Converted 1024.00 MB image at 458.44 MB/s Feb 27 12:37:26 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5eb4e801-d8e3-4cda-8647-e21e1786c36a is being set with open permissions: ugo+rw Feb 27 12:37:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5eb4e801-d8e3-4cda-8647-e21e1786c36a {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1d22e194-d3a0-4e03-9485-dbc4700b96c4 tempest-VolumeDependencyTests-56553957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1d22e194-d3a0-4e03-9485-dbc4700b96c4 tempest-VolumeDependencyTests-56553957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-1d22e194-d3a0-4e03-9485-dbc4700b96c4 tempest-VolumeDependencyTests-56553957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:26 devstack sudo[91109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5eb4e801-d8e3-4cda-8647-e21e1786c36a Feb 27 12:37:26 devstack sudo[91109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:26 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-1d22e194-d3a0-4e03-9485-dbc4700b96c4 tempest-VolumeDependencyTests-56553957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-1d22e194-d3a0-4e03-9485-dbc4700b96c4 tempest-VolumeDependencyTests-56553957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1d22e194-d3a0-4e03-9485-dbc4700b96c4 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:26 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:37:26 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:26 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc11033d-225f-44af-838d-1ca74385b518 tempest-VolumeDependencyTests-56553957 None] Acquiring lock "cinder-3e1790ea-2934-42a8-a204-5ccfa2f6946b-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:26 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc11033d-225f-44af-838d-1ca74385b518 tempest-VolumeDependencyTests-56553957 None] Lock "cinder-3e1790ea-2934-42a8-a204-5ccfa2f6946b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:26 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc11033d-225f-44af-838d-1ca74385b518 tempest-VolumeDependencyTests-56553957 None] Acquiring lock "cinder-quobyte-3e1790ea-2934-42a8-a204-5ccfa2f6946b" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:26 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc11033d-225f-44af-838d-1ca74385b518 tempest-VolumeDependencyTests-56553957 None] Lock "cinder-quobyte-3e1790ea-2934-42a8-a204-5ccfa2f6946b" acquired by "delete_volume" :: waited 0.008s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:26 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fdb31e-b29e-4f4b-8b80-e5a9d8befce8]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc11033d-225f-44af-838d-1ca74385b518 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-3e1790ea-2934-42a8-a204-5ccfa2f6946b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:26 devstack sudo[91119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-3e1790ea-2934-42a8-a204-5ccfa2f6946b Feb 27 12:37:26 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:26 devstack sudo[91109]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5eb4e801-d8e3-4cda-8647-e21e1786c36a" returned: 0 in 0.497s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:26 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Lock "cinder-quobyte-5eb4e801-d8e3-4cda-8647-e21e1786c36a" released by "_copy_volume_from_snapshot" :: held 4.649s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:26 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Lock "cinder-quobyte-d9f3b0f2-9e71-455c-908f-1c7e2149a0de-5eb4e801-d8e3-4cda-8647-e21e1786c36a" released by "_create_volume_from_snapshot" :: held 4.681s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.704s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:26 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:26 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-1d22e194-d3a0-4e03-9485-dbc4700b96c4 tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.509s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:26 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-1d22e194-d3a0-4e03-9485-dbc4700b96c4 tempest-VolumeDependencyTests-56553957 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc3af5c-33c2-475d-b962-aab47395e623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eb4e801-d8e3-4cda-8647-e21e1786c36a', 'volume_size': 1, 'snapshot_id': 'd9f3b0f2-9e71-455c-908f-1c7e2149a0de'}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:26 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e9cc17-6ded-4582-8559-31f84ee5f7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:26 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-1d22e194-d3a0-4e03-9485-dbc4700b96c4 tempest-VolumeDependencyTests-56553957 None] Deleted volume successfully. Feb 27 12:37:27 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Volume volume-5eb4e801-d8e3-4cda-8647-e21e1786c36a (5eb4e801-d8e3-4cda-8647-e21e1786c36a): created successfully Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e9cc17-6ded-4582-8559-31f84ee5f7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Flow 'volume_create_manager' (4dd658b6-13a2-445b-90f4-0311bc933d16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-1d22e194-d3a0-4e03-9485-dbc4700b96c4 tempest-VolumeDependencyTests-56553957 None] Lock "cinder-e85dad2a-e4f0-466d-8dc2-4a1e0b9386c4-delete_volume" released by "delete_volume" :: held 2.914s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:27 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-d039b2a6-da9c-45de-bb85-bcbf72c99aa1 tempest-SnapshotDependencyTests-1810568490 None] Created volume successfully. Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Flow 'volume_create_manager' (99a40f63-fff0-4053-9b54-bdcd6a73de29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd3c27e-205a-43dd-bf78-8590161c3e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd3c27e-205a-43dd-bf78-8590161c3e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621b5e38-5f49-494f-a787-1bc9450b048a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1df895236055463c8c86afab78d86b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:27Z,use_quota=True,user_id='78ad4418badb422fbd9fdf71419c0834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6796fe6-8dd9-42bd-91e9-550b8ac913b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6796fe6-8dd9-42bd-91e9-550b8ac913b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6596be8-a6bf-49db-95a8-ba7aa500ef75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6596be8-a6bf-49db-95a8-ba7aa500ef75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '621b5e38-5f49-494f-a787-1bc9450b048a', 'volume_name': 'volume-621b5e38-5f49-494f-a787-1bc9450b048a', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fab41004-45da-4074-84ff-2d836e8b8e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fab41004-45da-4074-84ff-2d836e8b8e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:27 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a160ca-c964-4e71-a174-f41923c12e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:27 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Volume 621b5e38-5f49-494f-a787-1bc9450b048a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-621b5e38-5f49-494f-a787-1bc9450b048a', 'volume_size': 1} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621b5e38-5f49-494f-a787-1bc9450b048a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1df895236055463c8c86afab78d86b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:27Z,use_quota=True,user_id='78ad4418badb422fbd9fdf71419c0834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Creating volume 621b5e38-5f49-494f-a787-1bc9450b048a {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:37:27 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-621b5e38-5f49-494f-a787-1bc9450b048a 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc11033d-225f-44af-838d-1ca74385b518 tempest-VolumeDependencyTests-56553957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-3e1790ea-2934-42a8-a204-5ccfa2f6946b" returned: 0 in 0.638s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc11033d-225f-44af-838d-1ca74385b518 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-3e1790ea-2934-42a8-a204-5ccfa2f6946b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:27 devstack sudo[91126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-621b5e38-5f49-494f-a787-1bc9450b048a 1073741824 Feb 27 12:37:27 devstack sudo[91126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-41cc3ebd-9fcc-41bd-b05c-091c2930b4e4 tempest-SnapshotDependencyTests-1810568490 None] Acquiring lock "cinder-d9f3b0f2-9e71-455c-908f-1c7e2149a0de-delete_snapshot" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-41cc3ebd-9fcc-41bd-b05c-091c2930b4e4 tempest-SnapshotDependencyTests-1810568490 None] Lock "cinder-d9f3b0f2-9e71-455c-908f-1c7e2149a0de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-41cc3ebd-9fcc-41bd-b05c-091c2930b4e4 tempest-SnapshotDependencyTests-1810568490 None] Acquiring lock "cinder-quobyte-5d449917-5611-408e-b78a-2cb05176464b" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-41cc3ebd-9fcc-41bd-b05c-091c2930b4e4 tempest-SnapshotDependencyTests-1810568490 None] Lock "cinder-quobyte-5d449917-5611-408e-b78a-2cb05176464b" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-41cc3ebd-9fcc-41bd-b05c-091c2930b4e4 tempest-SnapshotDependencyTests-1810568490 None] Acquiring lock "cinder-quobyte-d9f3b0f2-9e71-455c-908f-1c7e2149a0de" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-41cc3ebd-9fcc-41bd-b05c-091c2930b4e4 tempest-SnapshotDependencyTests-1810568490 None] Lock "cinder-quobyte-d9f3b0f2-9e71-455c-908f-1c7e2149a0de" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:27 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-3e1790ea-2934-42a8-a204-5ccfa2f6946b Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-41cc3ebd-9fcc-41bd-b05c-091c2930b4e4 tempest-SnapshotDependencyTests-1810568490 None] Deleting offline snapshot d9f3b0f2-9e71-455c-908f-1c7e2149a0de of volume 5d449917-5611-408e-b78a-2cb05176464b {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:37:27 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-41cc3ebd-9fcc-41bd-b05c-091c2930b4e4 tempest-SnapshotDependencyTests-1810568490 None] snapshot_file for this snap is: volume-5d449917-5611-408e-b78a-2cb05176464b.d9f3b0f2-9e71-455c-908f-1c7e2149a0de {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68252d0-25d0-4884-bbed-ea011ff2e9dc]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-41cc3ebd-9fcc-41bd-b05c-091c2930b4e4 tempest-SnapshotDependencyTests-1810568490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.d9f3b0f2-9e71-455c-908f-1c7e2149a0de {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:27 devstack sudo[91130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.d9f3b0f2-9e71-455c-908f-1c7e2149a0de Feb 27 12:37:27 devstack sudo[91130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:27 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc11033d-225f-44af-838d-1ca74385b518 tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-3e1790ea-2934-42a8-a204-5ccfa2f6946b" returned: 0 in 0.459s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc11033d-225f-44af-838d-1ca74385b518 tempest-VolumeDependencyTests-56553957 None] Lock "cinder-quobyte-3e1790ea-2934-42a8-a204-5ccfa2f6946b" released by "delete_volume" :: held 1.120s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:27 devstack sudo[91126]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-621b5e38-5f49-494f-a787-1bc9450b048a 1073741824" returned: 0 in 0.510s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-bc11033d-225f-44af-838d-1ca74385b518 tempest-VolumeDependencyTests-56553957 None] Created reservations ['381ae2cd-ddf2-415c-bec5-fbf6b00c1152', '7b852deb-8ea0-4eaa-98e9-5878ae300763', '97f71738-c38e-4eca-a7cb-b4a4f8ce89df', '5f9716a2-73ca-4747-bcb8-af956f644d62'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-621b5e38-5f49-494f-a787-1bc9450b048a {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:27 devstack sudo[91139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-621b5e38-5f49-494f-a787-1bc9450b048a Feb 27 12:37:27 devstack sudo[91139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bc11033d-225f-44af-838d-1ca74385b518 tempest-VolumeDependencyTests-56553957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bc11033d-225f-44af-838d-1ca74385b518 tempest-VolumeDependencyTests-56553957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bc11033d-225f-44af-838d-1ca74385b518 tempest-VolumeDependencyTests-56553957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-bc11033d-225f-44af-838d-1ca74385b518 tempest-VolumeDependencyTests-56553957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-bc11033d-225f-44af-838d-1ca74385b518 tempest-VolumeDependencyTests-56553957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc11033d-225f-44af-838d-1ca74385b518 tempest-VolumeDependencyTests-56553957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:27 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:37:27 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:27 devstack sudo[91130]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-41cc3ebd-9fcc-41bd-b05c-091c2930b4e4 tempest-SnapshotDependencyTests-1810568490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.d9f3b0f2-9e71-455c-908f-1c7e2149a0de" returned: 0 in 0.519s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-41cc3ebd-9fcc-41bd-b05c-091c2930b4e4 tempest-SnapshotDependencyTests-1810568490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d449917-5611-408e-b78a-2cb05176464b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9280e8aa-5bff-4d43-9d0c-6c12199c26e4]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:27 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-41cc3ebd-9fcc-41bd-b05c-091c2930b4e4 tempest-SnapshotDependencyTests-1810568490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:27 devstack sudo[91143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b Feb 27 12:37:27 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:28 devstack sudo[91139]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-621b5e38-5f49-494f-a787-1bc9450b048a" returned: 0 in 0.413s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:28 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:37:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:28 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a160ca-c964-4e71-a174-f41923c12e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-621b5e38-5f49-494f-a787-1bc9450b048a', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:28 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a75c12a-0316-4035-9cd4-21122c7b3459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:28 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Volume volume-621b5e38-5f49-494f-a787-1bc9450b048a (621b5e38-5f49-494f-a787-1bc9450b048a): created successfully Feb 27 12:37:28 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a75c12a-0316-4035-9cd4-21122c7b3459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:28 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Flow 'volume_create_manager' (99a40f63-fff0-4053-9b54-bdcd6a73de29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:28 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-28f10ccc-07f9-4eec-8892-97adc4e76bbd tempest-CinderUnicodeTest-1175597578 None] Created volume successfully. Feb 27 12:37:28 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-bc11033d-225f-44af-838d-1ca74385b518 tempest-VolumeDependencyTests-56553957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.477s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:28 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-bc11033d-225f-44af-838d-1ca74385b518 tempest-VolumeDependencyTests-56553957 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:28 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-bc11033d-225f-44af-838d-1ca74385b518 tempest-VolumeDependencyTests-56553957 None] Deleted volume successfully. Feb 27 12:37:28 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-bc11033d-225f-44af-838d-1ca74385b518 tempest-VolumeDependencyTests-56553957 None] Lock "cinder-3e1790ea-2934-42a8-a204-5ccfa2f6946b-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:28 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-41cc3ebd-9fcc-41bd-b05c-091c2930b4e4 tempest-SnapshotDependencyTests-1810568490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b" returned: 0 in 0.540s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-41cc3ebd-9fcc-41bd-b05c-091c2930b4e4 tempest-SnapshotDependencyTests-1810568490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.d9f3b0f2-9e71-455c-908f-1c7e2149a0de {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:28 devstack sudo[91184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.d9f3b0f2-9e71-455c-908f-1c7e2149a0de Feb 27 12:37:28 devstack sudo[91184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:28 devstack sudo[91184]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-41cc3ebd-9fcc-41bd-b05c-091c2930b4e4 tempest-SnapshotDependencyTests-1810568490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.d9f3b0f2-9e71-455c-908f-1c7e2149a0de" returned: 0 in 0.482s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:28 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-41cc3ebd-9fcc-41bd-b05c-091c2930b4e4 tempest-SnapshotDependencyTests-1810568490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.d9f3b0f2-9e71-455c-908f-1c7e2149a0de {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:28 devstack sudo[91189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.d9f3b0f2-9e71-455c-908f-1c7e2149a0de Feb 27 12:37:28 devstack sudo[91189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:29 devstack sudo[91189]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-41cc3ebd-9fcc-41bd-b05c-091c2930b4e4 tempest-SnapshotDependencyTests-1810568490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b.d9f3b0f2-9e71-455c-908f-1c7e2149a0de" returned: 0 in 0.478s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:29 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-41cc3ebd-9fcc-41bd-b05c-091c2930b4e4 tempest-SnapshotDependencyTests-1810568490 None] Lock "cinder-quobyte-d9f3b0f2-9e71-455c-908f-1c7e2149a0de" released by "_delete_snapshot" :: held 2.082s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:29 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-41cc3ebd-9fcc-41bd-b05c-091c2930b4e4 tempest-SnapshotDependencyTests-1810568490 None] Lock "cinder-quobyte-5d449917-5611-408e-b78a-2cb05176464b" released by "delete_snapshot" :: held 2.097s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:29 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-41cc3ebd-9fcc-41bd-b05c-091c2930b4e4 tempest-SnapshotDependencyTests-1810568490 None] Created reservations ['a744f7e0-b233-43eb-8c16-a6ad4985d155', 'a3b42e85-75f7-4640-9b35-1bdd44b44582', '8bbd380d-eb57-405f-b1ae-377bf5fc9278', '3de91e92-8f96-4128-8c9f-30893548b6d2'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:29 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-41cc3ebd-9fcc-41bd-b05c-091c2930b4e4 tempest-SnapshotDependencyTests-1810568490 None] Delete snapshot completed successfully. Feb 27 12:37:29 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-41cc3ebd-9fcc-41bd-b05c-091c2930b4e4 tempest-SnapshotDependencyTests-1810568490 None] Lock "cinder-d9f3b0f2-9e71-455c-908f-1c7e2149a0de-delete_snapshot" released by "delete_snapshot" :: held 2.204s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:29 devstack cinder-volume[83077]: DEBUG cinder.volume.flows.manager.create_volume [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:37:29 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Flow 'volume_create_manager' (25c0ceee-260e-4537-8556-ec4bbaedef96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:29 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e262150-041f-4909-83f4-3361f929808b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:29 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e262150-041f-4909-83f4-3361f929808b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2063724545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e1b23d8-4fca-40b1-a8cf-2e1df7380da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1df895236055463c8c86afab78d86b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:30Z,use_quota=True,user_id='78ad4418badb422fbd9fdf71419c0834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:29 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e25a599-9dae-4c5b-89b2-bebed86038df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:29 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e25a599-9dae-4c5b-89b2-bebed86038df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:29 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cc021b-b316-4c0d-8da6-dd13b1e4d261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:29 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cc021b-b316-4c0d-8da6-dd13b1e4d261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e1b23d8-4fca-40b1-a8cf-2e1df7380da8', 'volume_name': 'volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:29 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f900a2-2a4a-4079-be0f-b5d79112e91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:29 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f900a2-2a4a-4079-be0f-b5d79112e91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:29 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410cbf19-439c-4763-8c86-2437a4c3d7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:29 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Volume 1e1b23d8-4fca-40b1-a8cf-2e1df7380da8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8', 'volume_size': 1} Feb 27 12:37:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:29 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2063724545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e1b23d8-4fca-40b1-a8cf-2e1df7380da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1df895236055463c8c86afab78d86b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:30Z,use_quota=True,user_id='78ad4418badb422fbd9fdf71419c0834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15),volume_type_id=a1cdf3f7-1d8d-4160-91d3-1cf44b3b3c15)}" {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:37:29 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Creating volume 1e1b23d8-4fca-40b1-a8cf-2e1df7380da8 {{(pid=83077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:37:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:29 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:29 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:29 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Selected osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 as target Quobyte volume. {{(pid=83077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:37:29 devstack cinder-volume[83077]: INFO cinder.volume.drivers.remotefs [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] casted to osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84 Feb 27 12:37:29 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8 1073741824 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:29 devstack sudo[91192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8 1073741824 Feb 27 12:37:29 devstack sudo[91192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:30 devstack sudo[91192]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8 1073741824" returned: 0 in 0.473s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:30 devstack sudo[91197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8 Feb 27 12:37:30 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:30 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-48868357-a5b1-4b03-9435-ed2e56963df9 tempest-SnapshotDependencyTests-1810568490 None] Acquiring lock "cinder-5d449917-5611-408e-b78a-2cb05176464b-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:30 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-48868357-a5b1-4b03-9435-ed2e56963df9 tempest-SnapshotDependencyTests-1810568490 None] Lock "cinder-5d449917-5611-408e-b78a-2cb05176464b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:30 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-48868357-a5b1-4b03-9435-ed2e56963df9 tempest-SnapshotDependencyTests-1810568490 None] Acquiring lock "cinder-quobyte-5d449917-5611-408e-b78a-2cb05176464b" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:30 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-48868357-a5b1-4b03-9435-ed2e56963df9 tempest-SnapshotDependencyTests-1810568490 None] Lock "cinder-quobyte-5d449917-5611-408e-b78a-2cb05176464b" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:30 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de25cb3-dc5e-4678-a98e-de80493df55c]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-48868357-a5b1-4b03-9435-ed2e56963df9 tempest-SnapshotDependencyTests-1810568490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:30 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8" returned: 0 in 0.404s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:30 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'} {{(pid=83077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:37:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:30 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410cbf19-439c-4763-8c86-2437a4c3d7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8', 'volume_size': 1}' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:30 devstack sudo[91200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b Feb 27 12:37:30 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df86ce93-e03e-4d94-94ac-a7f4da706f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:30 devstack sudo[91200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:30 devstack cinder-volume[83077]: INFO cinder.volume.flows.manager.create_volume [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Volume volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8 (1e1b23d8-4fca-40b1-a8cf-2e1df7380da8): created successfully Feb 27 12:37:30 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df86ce93-e03e-4d94-94ac-a7f4da706f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83077) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:30 devstack cinder-volume[83077]: DEBUG cinder.volume.manager [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Flow 'volume_create_manager' (25c0ceee-260e-4537-8556-ec4bbaedef96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83077) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:30 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-41e3e1e0-7190-43f8-b7e1-1c86dacad3c0 tempest-CinderUnicodeTest-1175597578 None] Created volume successfully. Feb 27 12:37:30 devstack sudo[91200]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-48868357-a5b1-4b03-9435-ed2e56963df9 tempest-SnapshotDependencyTests-1810568490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b" returned: 0 in 0.450s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:30 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-48868357-a5b1-4b03-9435-ed2e56963df9 tempest-SnapshotDependencyTests-1810568490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:30 devstack sudo[91205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b Feb 27 12:37:30 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:31 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-48868357-a5b1-4b03-9435-ed2e56963df9 tempest-SnapshotDependencyTests-1810568490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5d449917-5611-408e-b78a-2cb05176464b" returned: 0 in 0.381s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-48868357-a5b1-4b03-9435-ed2e56963df9 tempest-SnapshotDependencyTests-1810568490 None] Lock "cinder-quobyte-5d449917-5611-408e-b78a-2cb05176464b" released by "delete_volume" :: held 0.869s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:31 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-48868357-a5b1-4b03-9435-ed2e56963df9 tempest-SnapshotDependencyTests-1810568490 None] Created reservations ['76cacc7a-bbb0-47c0-af7f-0477c694703d', '8b66ddd5-dd46-4f8e-ab87-f5684f89ec82', '874a2cbc-0f91-4336-8e5d-e3c51e495875', 'a882ce81-ac47-4f28-9551-8f39f3a68fe4'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-48868357-a5b1-4b03-9435-ed2e56963df9 tempest-SnapshotDependencyTests-1810568490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-48868357-a5b1-4b03-9435-ed2e56963df9 tempest-SnapshotDependencyTests-1810568490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:31 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-48868357-a5b1-4b03-9435-ed2e56963df9 tempest-SnapshotDependencyTests-1810568490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:31 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-48868357-a5b1-4b03-9435-ed2e56963df9 tempest-SnapshotDependencyTests-1810568490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-48868357-a5b1-4b03-9435-ed2e56963df9 tempest-SnapshotDependencyTests-1810568490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-48868357-a5b1-4b03-9435-ed2e56963df9 tempest-SnapshotDependencyTests-1810568490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:31 devstack sudo[91209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:37:31 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cff4b4a0-94ca-4bff-8dd0-abf852de6dcb tempest-SnapshotDependencyTests-1810568490 None] Acquiring lock "cinder-5eb4e801-d8e3-4cda-8647-e21e1786c36a-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cff4b4a0-94ca-4bff-8dd0-abf852de6dcb tempest-SnapshotDependencyTests-1810568490 None] Lock "cinder-5eb4e801-d8e3-4cda-8647-e21e1786c36a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cff4b4a0-94ca-4bff-8dd0-abf852de6dcb tempest-SnapshotDependencyTests-1810568490 None] Acquiring lock "cinder-quobyte-5eb4e801-d8e3-4cda-8647-e21e1786c36a" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cff4b4a0-94ca-4bff-8dd0-abf852de6dcb tempest-SnapshotDependencyTests-1810568490 None] Lock "cinder-quobyte-5eb4e801-d8e3-4cda-8647-e21e1786c36a" acquired by "delete_volume" :: waited 0.006s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:31 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9aa6018-5c49-4ce2-8338-b5e45daa2e38]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cff4b4a0-94ca-4bff-8dd0-abf852de6dcb tempest-SnapshotDependencyTests-1810568490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5eb4e801-d8e3-4cda-8647-e21e1786c36a {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:31 devstack sudo[91211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5eb4e801-d8e3-4cda-8647-e21e1786c36a Feb 27 12:37:31 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:31 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0f91dc24-1e02-4819-92c4-a1dc7172e555 tempest-CinderUnicodeTest-1175597578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0f91dc24-1e02-4819-92c4-a1dc7172e555 tempest-CinderUnicodeTest-1175597578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-48868357-a5b1-4b03-9435-ed2e56963df9 tempest-SnapshotDependencyTests-1810568490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.495s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:31 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-48868357-a5b1-4b03-9435-ed2e56963df9 tempest-SnapshotDependencyTests-1810568490 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:31 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-0f91dc24-1e02-4819-92c4-a1dc7172e555 tempest-CinderUnicodeTest-1175597578 None] Creating offline snapshot 9688a3f4-a3ab-456c-909f-4f550d83b809 of volume 1e1b23d8-4fca-40b1-a8cf-2e1df7380da8 {{(pid=83077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:37:31 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-48868357-a5b1-4b03-9435-ed2e56963df9 tempest-SnapshotDependencyTests-1810568490 None] Deleted volume successfully. Feb 27 12:37:31 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cef993-82c4-467d-891c-c6ed507b4177]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:31 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0f91dc24-1e02-4819-92c4-a1dc7172e555 tempest-CinderUnicodeTest-1175597578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:31 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-48868357-a5b1-4b03-9435-ed2e56963df9 tempest-SnapshotDependencyTests-1810568490 None] Lock "cinder-5d449917-5611-408e-b78a-2cb05176464b-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:32 devstack sudo[91214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8 Feb 27 12:37:32 devstack sudo[91214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:32 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cff4b4a0-94ca-4bff-8dd0-abf852de6dcb tempest-SnapshotDependencyTests-1810568490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5eb4e801-d8e3-4cda-8647-e21e1786c36a" returned: 0 in 0.490s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cff4b4a0-94ca-4bff-8dd0-abf852de6dcb tempest-SnapshotDependencyTests-1810568490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5eb4e801-d8e3-4cda-8647-e21e1786c36a {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:32 devstack sudo[91219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5eb4e801-d8e3-4cda-8647-e21e1786c36a Feb 27 12:37:32 devstack sudo[91219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:32 devstack sudo[91214]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0f91dc24-1e02-4819-92c4-a1dc7172e555 tempest-CinderUnicodeTest-1175597578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8" returned: 0 in 0.452s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0f91dc24-1e02-4819-92c4-a1dc7172e555 tempest-CinderUnicodeTest-1175597578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8.9688a3f4-a3ab-456c-909f-4f550d83b809 1G {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:32 devstack sudo[91224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8.9688a3f4-a3ab-456c-909f-4f550d83b809 1G Feb 27 12:37:32 devstack sudo[91224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:32 devstack sudo[91219]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cff4b4a0-94ca-4bff-8dd0-abf852de6dcb tempest-SnapshotDependencyTests-1810568490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-5eb4e801-d8e3-4cda-8647-e21e1786c36a" returned: 0 in 0.376s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:32 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cff4b4a0-94ca-4bff-8dd0-abf852de6dcb tempest-SnapshotDependencyTests-1810568490 None] Lock "cinder-quobyte-5eb4e801-d8e3-4cda-8647-e21e1786c36a" released by "delete_volume" :: held 0.899s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:32 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-cff4b4a0-94ca-4bff-8dd0-abf852de6dcb tempest-SnapshotDependencyTests-1810568490 None] Created reservations ['0901c785-5b78-4461-8d68-d938a186253d', '32a2d75a-dc6f-4419-af66-7c84fb283aec', 'd61d215e-ba01-4d72-881b-46a24b75c4ab', 'a52eaf6d-5279-41f9-95b1-37ecd2d00f87'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-cff4b4a0-94ca-4bff-8dd0-abf852de6dcb tempest-SnapshotDependencyTests-1810568490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-cff4b4a0-94ca-4bff-8dd0-abf852de6dcb tempest-SnapshotDependencyTests-1810568490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:32 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-cff4b4a0-94ca-4bff-8dd0-abf852de6dcb tempest-SnapshotDependencyTests-1810568490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:32 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-cff4b4a0-94ca-4bff-8dd0-abf852de6dcb tempest-SnapshotDependencyTests-1810568490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-cff4b4a0-94ca-4bff-8dd0-abf852de6dcb tempest-SnapshotDependencyTests-1810568490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cff4b4a0-94ca-4bff-8dd0-abf852de6dcb tempest-SnapshotDependencyTests-1810568490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:32 devstack sudo[91227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:37:32 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:32 devstack sudo[91224]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0f91dc24-1e02-4819-92c4-a1dc7172e555 tempest-CinderUnicodeTest-1175597578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8.9688a3f4-a3ab-456c-909f-4f550d83b809 1G" returned: 0 in 0.472s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:32 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0f91dc24-1e02-4819-92c4-a1dc7172e555 tempest-CinderUnicodeTest-1175597578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8.9688a3f4-a3ab-456c-909f-4f550d83b809 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:32 devstack sudo[91232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8.9688a3f4-a3ab-456c-909f-4f550d83b809 Feb 27 12:37:32 devstack sudo[91232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:33 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-cff4b4a0-94ca-4bff-8dd0-abf852de6dcb tempest-SnapshotDependencyTests-1810568490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.449s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:33 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-cff4b4a0-94ca-4bff-8dd0-abf852de6dcb tempest-SnapshotDependencyTests-1810568490 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:33 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-cff4b4a0-94ca-4bff-8dd0-abf852de6dcb tempest-SnapshotDependencyTests-1810568490 None] Deleted volume successfully. Feb 27 12:37:33 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-cff4b4a0-94ca-4bff-8dd0-abf852de6dcb tempest-SnapshotDependencyTests-1810568490 None] Lock "cinder-5eb4e801-d8e3-4cda-8647-e21e1786c36a-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:33 devstack sudo[91232]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0f91dc24-1e02-4819-92c4-a1dc7172e555 tempest-CinderUnicodeTest-1175597578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8 -F qcow2 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8.9688a3f4-a3ab-456c-909f-4f550d83b809" returned: 0 in 0.463s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:33 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-0f91dc24-1e02-4819-92c4-a1dc7172e555 tempest-CinderUnicodeTest-1175597578 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8.9688a3f4-a3ab-456c-909f-4f550d83b809 is being set with open permissions: ugo+rw Feb 27 12:37:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0f91dc24-1e02-4819-92c4-a1dc7172e555 tempest-CinderUnicodeTest-1175597578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8.9688a3f4-a3ab-456c-909f-4f550d83b809 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:33 devstack sudo[91238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8.9688a3f4-a3ab-456c-909f-4f550d83b809 Feb 27 12:37:33 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:33 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0f91dc24-1e02-4819-92c4-a1dc7172e555 tempest-CinderUnicodeTest-1175597578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8.9688a3f4-a3ab-456c-909f-4f550d83b809" returned: 0 in 0.438s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:33 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0f91dc24-1e02-4819-92c4-a1dc7172e555 tempest-CinderUnicodeTest-1175597578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:33 devstack sudo[91242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8.info Feb 27 12:37:33 devstack sudo[91242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:34 devstack sudo[91242]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0f91dc24-1e02-4819-92c4-a1dc7172e555 tempest-CinderUnicodeTest-1175597578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8.info" returned: 0 in 0.429s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:34 devstack cinder-volume[83077]: WARNING cinder.volume.drivers.remotefs [None req-0f91dc24-1e02-4819-92c4-a1dc7172e555 tempest-CinderUnicodeTest-1175597578 None] /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8.info is being set with open permissions: ugo+rw Feb 27 12:37:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0f91dc24-1e02-4819-92c4-a1dc7172e555 tempest-CinderUnicodeTest-1175597578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8.info {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:34 devstack sudo[91245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8.info Feb 27 12:37:34 devstack sudo[91245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:34 devstack sudo[91245]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-0f91dc24-1e02-4819-92c4-a1dc7172e555 tempest-CinderUnicodeTest-1175597578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8.info" returned: 0 in 0.457s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:34 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-0f91dc24-1e02-4819-92c4-a1dc7172e555 tempest-CinderUnicodeTest-1175597578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.772s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:34 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-0f91dc24-1e02-4819-92c4-a1dc7172e555 tempest-CinderUnicodeTest-1175597578 None] Create snapshot completed successfully Feb 27 12:37:35 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-71790080-c07b-49cb-98b0-7e646861a106 tempest-CinderUnicodeTest-1175597578 None] Acquiring lock "cinder-9688a3f4-a3ab-456c-909f-4f550d83b809-delete_snapshot" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:35 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-71790080-c07b-49cb-98b0-7e646861a106 tempest-CinderUnicodeTest-1175597578 None] Lock "cinder-9688a3f4-a3ab-456c-909f-4f550d83b809-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:35 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-71790080-c07b-49cb-98b0-7e646861a106 tempest-CinderUnicodeTest-1175597578 None] Acquiring lock "cinder-quobyte-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8" by "delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:35 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-71790080-c07b-49cb-98b0-7e646861a106 tempest-CinderUnicodeTest-1175597578 None] Lock "cinder-quobyte-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:35 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-71790080-c07b-49cb-98b0-7e646861a106 tempest-CinderUnicodeTest-1175597578 None] Acquiring lock "cinder-quobyte-9688a3f4-a3ab-456c-909f-4f550d83b809" by "_delete_snapshot" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:35 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-71790080-c07b-49cb-98b0-7e646861a106 tempest-CinderUnicodeTest-1175597578 None] Lock "cinder-quobyte-9688a3f4-a3ab-456c-909f-4f550d83b809" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:35 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-71790080-c07b-49cb-98b0-7e646861a106 tempest-CinderUnicodeTest-1175597578 None] Deleting offline snapshot 9688a3f4-a3ab-456c-909f-4f550d83b809 of volume 1e1b23d8-4fca-40b1-a8cf-2e1df7380da8 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:37:35 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-71790080-c07b-49cb-98b0-7e646861a106 tempest-CinderUnicodeTest-1175597578 None] snapshot_file for this snap is: volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8.9688a3f4-a3ab-456c-909f-4f550d83b809 {{(pid=83077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:37:35 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e26203d-e210-4110-9553-4127945d1869]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-71790080-c07b-49cb-98b0-7e646861a106 tempest-CinderUnicodeTest-1175597578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8.9688a3f4-a3ab-456c-909f-4f550d83b809 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:35 devstack sudo[91249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8.9688a3f4-a3ab-456c-909f-4f550d83b809 Feb 27 12:37:35 devstack sudo[91249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:35 devstack sudo[91249]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-71790080-c07b-49cb-98b0-7e646861a106 tempest-CinderUnicodeTest-1175597578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8.9688a3f4-a3ab-456c-909f-4f550d83b809" returned: 0 in 0.450s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:35 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.remotefs [None req-71790080-c07b-49cb-98b0-7e646861a106 tempest-CinderUnicodeTest-1175597578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:37:35 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[469293c0-901d-4337-b1ce-738ef8a1135d]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:35 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-71790080-c07b-49cb-98b0-7e646861a106 tempest-CinderUnicodeTest-1175597578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:35 devstack sudo[91254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8 Feb 27 12:37:35 devstack sudo[91254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:36 devstack sudo[91254]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-71790080-c07b-49cb-98b0-7e646861a106 tempest-CinderUnicodeTest-1175597578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8" returned: 0 in 0.522s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-71790080-c07b-49cb-98b0-7e646861a106 tempest-CinderUnicodeTest-1175597578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8.9688a3f4-a3ab-456c-909f-4f550d83b809 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:36 devstack sudo[91260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8.9688a3f4-a3ab-456c-909f-4f550d83b809 Feb 27 12:37:36 devstack sudo[91260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:36 devstack sudo[91260]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-71790080-c07b-49cb-98b0-7e646861a106 tempest-CinderUnicodeTest-1175597578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8.9688a3f4-a3ab-456c-909f-4f550d83b809" returned: 0 in 0.457s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-71790080-c07b-49cb-98b0-7e646861a106 tempest-CinderUnicodeTest-1175597578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8.9688a3f4-a3ab-456c-909f-4f550d83b809 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:36 devstack sudo[91265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8.9688a3f4-a3ab-456c-909f-4f550d83b809 Feb 27 12:37:36 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:36 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:36 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-71790080-c07b-49cb-98b0-7e646861a106 tempest-CinderUnicodeTest-1175597578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8.9688a3f4-a3ab-456c-909f-4f550d83b809" returned: 0 in 0.426s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:37 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-71790080-c07b-49cb-98b0-7e646861a106 tempest-CinderUnicodeTest-1175597578 None] Lock "cinder-quobyte-9688a3f4-a3ab-456c-909f-4f550d83b809" released by "_delete_snapshot" :: held 1.919s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:37 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-71790080-c07b-49cb-98b0-7e646861a106 tempest-CinderUnicodeTest-1175597578 None] Lock "cinder-quobyte-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8" released by "delete_snapshot" :: held 1.931s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:37 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-71790080-c07b-49cb-98b0-7e646861a106 tempest-CinderUnicodeTest-1175597578 None] Created reservations ['309c8f60-9e73-4143-9bb7-05d8012c1e5b', '982f08a1-23cf-4650-8048-b42179babac8', '3f3c2e15-8118-4ad5-9e63-9c05deb59518', 'f71a82cf-f2b6-4d33-9415-9f94af1c8f96'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:37 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-71790080-c07b-49cb-98b0-7e646861a106 tempest-CinderUnicodeTest-1175597578 None] Delete snapshot completed successfully. Feb 27 12:37:37 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-71790080-c07b-49cb-98b0-7e646861a106 tempest-CinderUnicodeTest-1175597578 None] Lock "cinder-9688a3f4-a3ab-456c-909f-4f550d83b809-delete_snapshot" released by "delete_snapshot" :: held 2.014s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:37 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5399f3f9-637a-4917-bc27-2ce4f5dd5b86 tempest-CinderUnicodeTest-1175597578 None] Acquiring lock "cinder-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:37 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5399f3f9-637a-4917-bc27-2ce4f5dd5b86 tempest-CinderUnicodeTest-1175597578 None] Lock "cinder-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:37 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5399f3f9-637a-4917-bc27-2ce4f5dd5b86 tempest-CinderUnicodeTest-1175597578 None] Acquiring lock "cinder-quobyte-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:37 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5399f3f9-637a-4917-bc27-2ce4f5dd5b86 tempest-CinderUnicodeTest-1175597578 None] Lock "cinder-quobyte-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8" acquired by "delete_volume" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:37 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[5173978e-65ce-4ef4-a6d2-e2fa09e6ccdf]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5399f3f9-637a-4917-bc27-2ce4f5dd5b86 tempest-CinderUnicodeTest-1175597578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:37 devstack sudo[91268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8 Feb 27 12:37:37 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:37 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5399f3f9-637a-4917-bc27-2ce4f5dd5b86 tempest-CinderUnicodeTest-1175597578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8" returned: 0 in 0.535s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:37 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5399f3f9-637a-4917-bc27-2ce4f5dd5b86 tempest-CinderUnicodeTest-1175597578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8 {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:37 devstack sudo[91274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8 Feb 27 12:37:37 devstack sudo[91274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:38 devstack sudo[91274]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5399f3f9-637a-4917-bc27-2ce4f5dd5b86 tempest-CinderUnicodeTest-1175597578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8" returned: 0 in 0.486s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:38 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5399f3f9-637a-4917-bc27-2ce4f5dd5b86 tempest-CinderUnicodeTest-1175597578 None] Lock "cinder-quobyte-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8" released by "delete_volume" :: held 1.065s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:38 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-5399f3f9-637a-4917-bc27-2ce4f5dd5b86 tempest-CinderUnicodeTest-1175597578 None] Created reservations ['ca86a578-d675-48e3-ac1c-7a2a6d998c92', '54053cc7-a31f-4e20-8629-213e8d85fdeb', 'ef2fb132-c385-4ba3-8a8d-9672e9489c44', '09e88312-5d88-4021-8b44-f7a7f0b9f5ba'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-5399f3f9-637a-4917-bc27-2ce4f5dd5b86 tempest-CinderUnicodeTest-1175597578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-5399f3f9-637a-4917-bc27-2ce4f5dd5b86 tempest-CinderUnicodeTest-1175597578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:38 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-5399f3f9-637a-4917-bc27-2ce4f5dd5b86 tempest-CinderUnicodeTest-1175597578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:38 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-5399f3f9-637a-4917-bc27-2ce4f5dd5b86 tempest-CinderUnicodeTest-1175597578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-5399f3f9-637a-4917-bc27-2ce4f5dd5b86 tempest-CinderUnicodeTest-1175597578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5399f3f9-637a-4917-bc27-2ce4f5dd5b86 tempest-CinderUnicodeTest-1175597578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:38 devstack sudo[91277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:37:38 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:38 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:38 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-5399f3f9-637a-4917-bc27-2ce4f5dd5b86 tempest-CinderUnicodeTest-1175597578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.430s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:38 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-5399f3f9-637a-4917-bc27-2ce4f5dd5b86 tempest-CinderUnicodeTest-1175597578 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:38 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-5399f3f9-637a-4917-bc27-2ce4f5dd5b86 tempest-CinderUnicodeTest-1175597578 None] Deleted volume successfully. Feb 27 12:37:38 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-5399f3f9-637a-4917-bc27-2ce4f5dd5b86 tempest-CinderUnicodeTest-1175597578 None] Lock "cinder-1e1b23d8-4fca-40b1-a8cf-2e1df7380da8-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:39 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-273a5c17-2f84-4892-b7c7-e367d9fb6042 tempest-CinderUnicodeTest-1175597578 None] Acquiring lock "cinder-621b5e38-5f49-494f-a787-1bc9450b048a-delete_volume" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:39 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-273a5c17-2f84-4892-b7c7-e367d9fb6042 tempest-CinderUnicodeTest-1175597578 None] Lock "cinder-621b5e38-5f49-494f-a787-1bc9450b048a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:39 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-273a5c17-2f84-4892-b7c7-e367d9fb6042 tempest-CinderUnicodeTest-1175597578 None] Acquiring lock "cinder-quobyte-621b5e38-5f49-494f-a787-1bc9450b048a" by "delete_volume" {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:39 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-273a5c17-2f84-4892-b7c7-e367d9fb6042 tempest-CinderUnicodeTest-1175597578 None] Lock "cinder-quobyte-621b5e38-5f49-494f-a787-1bc9450b048a" acquired by "delete_volume" :: waited 0.010s {{(pid=83077) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:39 devstack cinder-volume[83077]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2f05cd-a68e-4cb4-b223-dfcc4ee47767]: (4, 'qcow2') {{(pid=83785) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-273a5c17-2f84-4892-b7c7-e367d9fb6042 tempest-CinderUnicodeTest-1175597578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-621b5e38-5f49-494f-a787-1bc9450b048a {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:39 devstack sudo[91280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-621b5e38-5f49-494f-a787-1bc9450b048a Feb 27 12:37:39 devstack sudo[91280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:39 devstack sudo[91280]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-273a5c17-2f84-4892-b7c7-e367d9fb6042 tempest-CinderUnicodeTest-1175597578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-621b5e38-5f49-494f-a787-1bc9450b048a" returned: 0 in 0.435s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:39 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-273a5c17-2f84-4892-b7c7-e367d9fb6042 tempest-CinderUnicodeTest-1175597578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-621b5e38-5f49-494f-a787-1bc9450b048a {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:39 devstack sudo[91285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-621b5e38-5f49-494f-a787-1bc9450b048a Feb 27 12:37:39 devstack sudo[91285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:40 devstack sudo[91285]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-273a5c17-2f84-4892-b7c7-e367d9fb6042 tempest-CinderUnicodeTest-1175597578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e/volume-621b5e38-5f49-494f-a787-1bc9450b048a" returned: 0 in 0.387s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:40 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-273a5c17-2f84-4892-b7c7-e367d9fb6042 tempest-CinderUnicodeTest-1175597578 None] Lock "cinder-quobyte-621b5e38-5f49-494f-a787-1bc9450b048a" released by "delete_volume" :: held 0.846s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:40 devstack cinder-volume[83077]: DEBUG cinder.quota [None req-273a5c17-2f84-4892-b7c7-e367d9fb6042 tempest-CinderUnicodeTest-1175597578 None] Created reservations ['d3596cc9-99f9-46d9-a921-0870c3d67d19', '6d29323f-0b65-40a8-a065-2d42a39ddd0f', '434c4ccf-c3cb-46d3-9b53-77069c11b027', 'c61c6662-0d8f-4a9b-a37e-192a5bb615b7'] {{(pid=83077) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-273a5c17-2f84-4892-b7c7-e367d9fb6042 tempest-CinderUnicodeTest-1175597578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-273a5c17-2f84-4892-b7c7-e367d9fb6042 tempest-CinderUnicodeTest-1175597578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:40 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-273a5c17-2f84-4892-b7c7-e367d9fb6042 tempest-CinderUnicodeTest-1175597578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84': None} {{(pid=83077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:40 devstack cinder-volume[83077]: DEBUG cinder.volume.drivers.quobyte [None req-273a5c17-2f84-4892-b7c7-e367d9fb6042 tempest-CinderUnicodeTest-1175597578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6b2e2ff4-985e-432b-ab8d-7aa6d0e58d84'] {{(pid=83077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.lockutils [None req-273a5c17-2f84-4892-b7c7-e367d9fb6042 tempest-CinderUnicodeTest-1175597578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83077) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-273a5c17-2f84-4892-b7c7-e367d9fb6042 tempest-CinderUnicodeTest-1175597578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:40 devstack sudo[91288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e Feb 27 12:37:40 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:40 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:40 devstack cinder-volume[83077]: DEBUG oslo_concurrency.processutils [None req-273a5c17-2f84-4892-b7c7-e367d9fb6042 tempest-CinderUnicodeTest-1175597578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b45e497d1f35b3dad5768783877bd11e" returned: 0 in 0.437s {{(pid=83077) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:40 devstack cinder-volume[83077]: DEBUG cinder.manager [None req-273a5c17-2f84-4892-b7c7-e367d9fb6042 tempest-CinderUnicodeTest-1175597578 None] Notifying Schedulers of capabilities ... {{(pid=83077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:40 devstack cinder-volume[83077]: INFO cinder.volume.manager [None req-273a5c17-2f84-4892-b7c7-e367d9fb6042 tempest-CinderUnicodeTest-1175597578 None] Deleted volume successfully. Feb 27 12:37:40 devstack cinder-volume[83077]: DEBUG cinder.coordination [None req-273a5c17-2f84-4892-b7c7-e367d9fb6042 tempest-CinderUnicodeTest-1175597578 None] Lock "cinder-621b5e38-5f49-494f-a787-1bc9450b048a-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=83077) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:50 devstack cinder-volume[83077]: DEBUG dbcounter [-] [83077] Writing DB stats cinder:SELECT=49,cinder:INSERT=15,cinder:UPDATE=76,cinder:DELETE=4 {{(pid=83077) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:37:50 devstack cinder-volume[83077]: DEBUG dbcounter [-] [83077] Writing DB stats cinder:SELECT=46,cinder:INSERT=20,cinder:UPDATE=59,cinder:DELETE=6 {{(pid=83077) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}